[ 534.906752] env[66913]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 534.906752] env[66913]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 535.930019] env[67003]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 535.930019] env[67003]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 537.796346] env[67003]: INFO neutron.common.config [-] Logging enabled! [ 537.796775] env[67003]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 27.0.1.dev79 [ 537.796846] env[67003]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=67003) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 537.797161] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 537.797268] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 537.798081] env[67003]: WARNING oslo_policy.policy [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 537.798300] env[67003]: WARNING oslo_policy.policy [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 537.799951] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] VMware NSXv3 Agent initialized successfully. [ 537.800316] env[67003]: DEBUG oslo_concurrency.lockutils [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] Acquiring lock "singleton_lock" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.800446] env[67003]: DEBUG oslo_concurrency.lockutils [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] Acquired lock "singleton_lock" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 537.800649] env[67003]: DEBUG oslo_concurrency.lockutils [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] Releasing lock "singleton_lock" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 537.800929] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] Full set of CONF: {{(pid=67003) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 537.801059] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ******************************************************************************** {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 537.801163] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] Configuration options gathered from: {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 537.801758] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 537.801937] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 537.802059] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ================================================================================ {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 537.802232] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] agent_down_time = 75 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.802372] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] allow_automatic_dhcp_failover = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.802508] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] allow_bulk = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.802659] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] api_extensions_path = {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.802829] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] api_paste_config = api-paste.ini {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.802995] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] auth_strategy = keystone {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.803119] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] backdoor_port = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.803210] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] backdoor_socket = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.803353] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] backlog = 4096 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.803488] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] base_mac = fa:16:3e:00:00:00 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.803643] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] bind_host = 0.0.0.0 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.803816] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] bind_port = 9696 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.803959] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] client_socket_timeout = 900 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.804110] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] config_dir = [] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.804218] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.804356] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] config_source = [] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.804496] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] control_exchange = neutron {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.804638] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] core_plugin = ml2 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.804774] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] debug = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.804912] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] default_availability_zones = [] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.805129] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.805270] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] dhcp_agent_notification = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.805407] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] dhcp_agents_per_network = 1 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.805539] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] dhcp_lease_duration = 86400 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.805678] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] dhcp_load_type = networks {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.805815] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] dns_domain = openstacklocal {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.805951] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.806092] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] enable_default_route_bfd = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.806222] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] enable_default_route_ecmp = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.806349] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] enable_dvr = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.806477] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] enable_new_agents = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.806608] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] enable_services_on_agents_with_admin_state_down = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.806741] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] enable_signals = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.806871] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] enable_traditional_dhcp = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.806998] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] external_dns_driver = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.807143] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] filter_validation = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.807283] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] global_physnet_mtu = 8950 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.807412] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] graceful_shutdown_timeout = 60 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.807583] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] host = cpu-1 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.807719] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] host_dvr_for_dhcp = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.807852] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] http_retries = 3 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.807991] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] instance_format = [instance: %(uuid)s] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.808140] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.808274] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ipam_driver = internal {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.808403] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ipv6_pd_enabled = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.808531] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] l3_ha = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.808667] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.808803] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] l3_ha_network_physical_name = {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.808935] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] l3_ha_network_type = {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.809084] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] log_color = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.809219] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] log_config_append = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.809351] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.809479] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] log_dir = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.809619] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] log_file = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.809731] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] log_options = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.809876] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] log_rotate_interval = 1 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.810062] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] log_rotate_interval_type = days {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.810208] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] log_rotation_type = none {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.810312] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.810413] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.810551] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.810685] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.810788] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.810920] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] max_dns_nameservers = 5 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.811062] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] max_header_line = 16384 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.811196] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] max_l3_agents_per_router = 3 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.811324] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] max_logfile_count = 30 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.811452] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] max_logfile_size_mb = 200 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.811578] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] max_subnet_host_routes = 20 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.811744] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] my_ip = 10.180.1.21 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.811885] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] my_ipv6 = ::1 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.812025] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] network_auto_schedule = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.812158] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] network_link_prefix = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.812301] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.812441] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] notify_nova_on_port_data_changes = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.812576] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] notify_nova_on_port_status_changes = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.812730] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] pagination_max_limit = -1 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.812872] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] publish_errors = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.813013] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] rate_limit_burst = 0 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.813157] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] rate_limit_except_level = CRITICAL {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.813287] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] rate_limit_interval = 0 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.813416] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] retry_until_window = 30 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.813545] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] router_distributed = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.813673] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] rpc_resources_processing_step = 20 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.813801] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] rpc_response_max_timeout = 600 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.813933] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] rpc_response_timeout = 60 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.814070] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] send_events_interval = 2 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.814221] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] service_plugins = ['router'] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.814359] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] setproctitle = on {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.814487] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] shell_completion = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.814622] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] state_path = /opt/stack/data/neutron {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.814758] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] syslog_log_facility = LOG_USER {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.814889] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] tcp_keepidle = 600 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.815036] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] transport_url = **** {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.815170] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] use_journal = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.815298] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] use_json = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.815425] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] use_ssl = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.815552] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] use_stderr = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.815684] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] use_syslog = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.815866] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] vlan_qinq = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.816041] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] vlan_transparent = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.816183] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] watch_log_file = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.816319] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] wsgi_default_pool_size = 100 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.816449] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] wsgi_keep_alive = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.816589] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.816725] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] wsgi_server_debug = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 537.816874] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_concurrency.disable_process_locking = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.817030] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.817178] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.817316] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.817456] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.817596] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.817731] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.817880] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler.connection_string = messaging:// {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.818031] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler.enabled = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.818173] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler.es_doc_type = notification {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.818308] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler.es_scroll_size = 10000 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.818445] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler.es_scroll_time = 2m {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.818577] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler.filter_error_trace = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.818715] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler.hmac_keys = **** {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.818859] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler.sentinel_service_name = mymaster {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.819012] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler.socket_timeout = 0.1 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.819150] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler.trace_requests = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.819281] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler.trace_sqlalchemy = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.819426] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler_jaeger.process_tags = {} {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.819601] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler_jaeger.service_name_prefix = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.819769] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] profiler_otlp.service_name_prefix = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.819926] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_policy.enforce_new_defaults = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.820209] env[67003]: WARNING oslo_config.cfg [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 537.820363] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_policy.enforce_scope = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.820505] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_policy.policy_default_rule = default {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.820657] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.820801] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.820947] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.821095] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.821232] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.821368] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.821506] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.821672] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_policy.remote_timeout = 60.0 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.821886] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.822064] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] agent.extensions = [] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.822214] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.822354] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] service_providers.service_provider = [] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.822501] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] QUOTAS.default_quota = -1 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.822650] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.822791] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] QUOTAS.quota_floatingip = 50 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.822926] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] QUOTAS.quota_network = 100 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.823071] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] QUOTAS.quota_port = 500 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.823208] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] QUOTAS.quota_rbac_policy = 10 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.823343] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] QUOTAS.quota_router = 10 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.823478] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] QUOTAS.quota_security_group = 10 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.823613] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] QUOTAS.quota_security_group_rule = 100 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.823752] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] QUOTAS.quota_subnet = 100 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.823884] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] QUOTAS.track_quota_usage = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.824064] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.824206] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep.group = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.824341] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep.helper_command = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.824476] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep.log_daemon_traceback = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.824617] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep.logger_name = oslo_privsep.daemon {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.824755] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep.thread_pool_size = 8 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.824886] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep.user = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.825041] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.825179] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_dhcp_release.group = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.825313] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_dhcp_release.helper_command = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.825445] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.825582] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.825714] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.825846] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_dhcp_release.user = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.825985] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.826128] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_ovs_vsctl.group = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.826260] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_ovs_vsctl.helper_command = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.826391] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.826526] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.826658] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.826792] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_ovs_vsctl.user = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.826929] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_namespace.capabilities = [21] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.827068] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_namespace.group = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.827201] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_namespace.helper_command = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.827335] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_namespace.log_daemon_traceback = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.827472] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.827604] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_namespace.thread_pool_size = 8 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.827735] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_namespace.user = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.827909] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_conntrack.capabilities = [12] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.828069] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_conntrack.group = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.828204] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_conntrack.helper_command = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.828343] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_conntrack.log_daemon_traceback = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.828500] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.828648] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_conntrack.thread_pool_size = 8 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.828782] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_conntrack.user = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.828949] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_link.capabilities = [12, 21] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.829148] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_link.group = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.829328] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_link.helper_command = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.829484] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_link.log_daemon_traceback = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.829636] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.829773] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_link.thread_pool_size = 8 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.829905] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] privsep_link.user = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.830072] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.830222] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.830361] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.continue_on_failed_promotions = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.830495] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.dscp = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.830629] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.dscp_inherit = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.830771] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.force_mp_to_policy = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.830905] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.locking_coordinator_url = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.831050] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.log_agent_heartbeats = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.831186] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.logging_expire = 1 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.831326] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.831457] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.831600] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.polling_interval = 240 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.831758] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.831902] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.quitting_rpc_timeout = 120 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.832058] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.report_interval = 30.0 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.832204] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.832344] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.832481] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.832629] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.sync_skew = 60 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.833061] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.synchronization_queue_size = 20 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.833061] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT.use_helper_for_ns_read = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.833061] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] SECURITYGROUP.enable_ipset = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.833199] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] SECURITYGROUP.enable_security_group = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.833328] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.833467] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.833613] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] experimental.ipv6_pd_enabled = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.833754] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ml2.extension_drivers = ['port_security'] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.833892] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ml2.external_network_type = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.834082] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.834233] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ml2.overlay_ip_version = 4 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.834375] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ml2.path_mtu = 8950 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.834514] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ml2.physical_network_mtus = {} {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.834659] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ml2.tenant_network_types = ['vlan'] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.834804] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.834948] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ml2.type_drivers = ['vlan'] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.835103] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT_CLI.neutron_port_id = [] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.835236] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.835369] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.835512] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.835654] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.835792] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.835933] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.836084] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.836227] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.836419] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.836564] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_login_password = **** {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.836709] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_login_port = 443 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.836849] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_login_user = admin {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.837056] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.837223] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.837363] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.837497] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.837636] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.837778] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.837915] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.838064] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.838202] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.838342] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.838483] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.838617] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.838759] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.838949] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.839107] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] vsphere.vsphere_login_password = VMware1! {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.839249] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.839384] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.839525] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] nova.auth_section = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.839702] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] nova.auth_type = password {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.839859] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.839994] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] nova.certfile = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.840148] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] nova.collect_timing = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.840298] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] nova.endpoint_type = public {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.840429] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] nova.insecure = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.840558] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] nova.keyfile = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.840697] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] nova.region_name = RegionOne {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.840834] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] nova.split_loggers = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.840963] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] nova.timeout = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.841115] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] placement.auth_section = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.841261] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] placement.auth_type = password {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.841402] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.841536] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] placement.certfile = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.841700] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] placement.collect_timing = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.841853] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] placement.endpoint_type = public {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.841994] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] placement.insecure = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.842141] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] placement.keyfile = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.842275] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] placement.region_name = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.842414] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] placement.split_loggers = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.842549] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] placement.timeout = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.842718] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.auth_section = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.842857] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.auth_type = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.842990] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.cafile = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.843136] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.certfile = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.843271] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.collect_timing = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.843404] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.connect_retries = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.843530] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.connect_retry_delay = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.843660] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.enable_notifications = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.843789] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.endpoint_override = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.843931] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.insecure = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.844098] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.interface = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.844233] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.keyfile = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.844368] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.max_version = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.844498] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.min_version = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.844627] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.region_name = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.844761] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.retriable_status_codes = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.844891] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.service_name = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.845027] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.service_type = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.845165] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.split_loggers = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.845295] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.status_code_retries = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.845423] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.status_code_retry_delay = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.845551] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.timeout = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.845679] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.valid_interfaces = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.845808] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ironic.version = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.845943] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] cli_script.dry_run = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.846100] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.846236] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.846368] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.846500] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.846630] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.846760] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.846888] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.847029] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.847166] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.847311] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.847443] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.847585] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.847725] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.847862] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.847999] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.848153] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.848290] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.848423] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.848563] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.848698] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.848831] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.848961] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.849104] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.849236] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.849365] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.849496] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.849648] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.849796] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.849928] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.850072] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.850210] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.ssl = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.850352] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.850492] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.850626] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.850768] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.850908] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.ssl_version = {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.851053] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.851202] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_notifications.driver = [] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.851335] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_notifications.retry = -1 {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.851485] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.851653] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] oslo_messaging_notifications.transport_url = **** {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 537.851780] env[67003]: DEBUG oslo_service.backend._eventlet.service [None req-fda6dbae-183a-4e39-a06e-c28f7f97943f None None] ******************************************************************************** {{(pid=67003) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 537.852924] env[67003]: DEBUG neutron.agent.securitygroups_rpc [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Init firewall settings (driver=nsxv3) {{(pid=67003) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 537.854248] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=67003) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 537.854481] env[67003]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] RPC agent_id: nsxm-l-01a.corp.local [ 537.856670] env[67003]: DEBUG dogpile.cache.region [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 537.856797] env[67003]: DEBUG dogpile.lock [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 537.856895] env[67003]: DEBUG dogpile.lock [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 537.856984] env[67003]: DEBUG dogpile.lock [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 537.857090] env[67003]: DEBUG dogpile.cache.region [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 537.857179] env[67003]: DEBUG dogpile.lock [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 537.857296] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 537.886760] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Session token - acquiring [ 537.888362] env[67003]: DEBUG networking_nsxv3.common.locking [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 537.888581] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 537.888643] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 537.889085] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 537.899902] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 538.178019] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 538.199218] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 538.199380] env[67003]: DEBUG dogpile.cache.region [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Cache value generated in 0.342 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 538.199508] env[67003]: DEBUG dogpile.lock [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 538.199601] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Activating Policy API Provider. [ 538.199785] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Looking for the default Infrastructure Rules. [ 538.262927] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Looking for the Default Layer3 Logged Drop Section. [ 538.278111] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 538.278586] env[67003]: DEBUG networking_nsxv3.common.locking [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 538.278760] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquiring lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 538.278867] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 538.279189] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired external semaphore "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 538.279639] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 538.795017] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.297271] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 539.799495] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Inventory metadata is going to be refreshed. [ 539.799800] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 540.503181] env[67003]: DEBUG networking_nsxv3.common.locking [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.503699] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.503699] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.503840] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.514470] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 540.515367] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 540.516403] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 540.534119] env[67003]: DEBUG networking_nsxv3.common.locking [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.534346] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.534387] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.534672] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.534795] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 540.534939] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 540.535063] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 540.535166] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 540.553399] env[67003]: DEBUG networking_nsxv3.common.locking [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.553594] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.553719] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.554040] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.554243] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 540.554383] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 540.573750] env[67003]: DEBUG networking_nsxv3.common.locking [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.573992] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.574119] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.574316] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.574460] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 540.574599] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 540.594403] env[67003]: DEBUG networking_nsxv3.common.locking [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.594691] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquiring lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.594691] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.594930] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired external semaphore "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.595087] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Releasing lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 540.595228] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 540.595328] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 540.595427] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 540.612810] env[67003]: DEBUG networking_nsxv3.common.locking [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.613053] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquiring lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.613192] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.613404] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired external semaphore "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.613528] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Releasing lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 540.613672] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 540.613776] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 540.613879] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 540.642772] env[67003]: DEBUG networking_nsxv3.common.locking [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 540.643086] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 540.643086] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 540.643347] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 540.643489] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 540.643637] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 540.643762] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 540.643866] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Inventory metadata have been refreshed. [ 540.643966] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Dryrun:True. Metadata refresh completed. [ 540.644111] env[67003]: DEBUG oslo_concurrency.lockutils [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Releasing lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 540.645753] env[67003]: INFO neutron.agent.agent_extensions_manager [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Loaded agent extensions: [] [ 540.646452] env[67003]: DEBUG neutron_lib.callbacks.manager [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=67003) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 540.698353] env[67003]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] NSXv3 Agent Agent RPC Daemon Started! [ 540.698491] env[67003]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] NSXv3 Agent Agent loop - iteration:0 started [ 540.698610] env[67003]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] NSXv3 Agent Agent out of sync with plugin! [ 545.646605] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 545.646982] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 550.648033] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 550.648033] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 552.648998] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 552.649421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 552.649421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 552.649636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 552.649884] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.152836] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 553.655329] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 554.157892] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 554.158163] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 554.870923] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.871329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.871329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.871418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.882156] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 554.884192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.884819] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 554.903529] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.903713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.903713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.903922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.904028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.904134] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 554.904217] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 554.904289] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 554.923973] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.924193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.924193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.924400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.924535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.924641] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 554.944883] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.945137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.945137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.945294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.945402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.945511] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 554.967306] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.967561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.967561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.967699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.967795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.967914] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 554.967986] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 554.968068] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 554.988626] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 554.988896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 554.988896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 554.989024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 554.989090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 554.989204] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 554.989277] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 554.989349] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 555.009925] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.010195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.010195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.010350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.010457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.010576] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 555.011159] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 555.011286] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 555.011415] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 555.011465] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 555.011521] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 555.011567] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 555.011919] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 555.012118] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 555.012213] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 555.031856] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.032109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.032151] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.032351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.032458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.032571] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 555.051742] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.051975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.051975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.052171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.052286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.064981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.385235] env[67003]: INFO networking_nsxv3.common.synchronization [None req-a7cebb07-1dca-46e5-983a-4f08b26050d8 demo admin] Enqueued Resource ID: 4bc6656d-c16f-4601-8679-b6c0515d1161 with Priority: HIGHEST for action security_group_rules [ 555.385826] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bc6656d-c16f-4601-8679-b6c0515d1161 with Priority: HIGHEST for action security_group_rules [ 555.386116] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4bc6656d-c16f-4601-8679-b6c0515d1161 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.386290] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4bc6656d-c16f-4601-8679-b6c0515d1161" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.386370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4bc6656d-c16f-4601-8679-b6c0515d1161" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.386634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4bc6656d-c16f-4601-8679-b6c0515d1161" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.386719] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4bc6656d-c16f-4601-8679-b6c0515d1161',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 555.907870] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 555.908329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 555.908329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 555.908329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 555.908437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 555.908469] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4bc6656d-c16f-4601-8679-b6c0515d1161 already deleted. [ 555.908581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4bc6656d-c16f-4601-8679-b6c0515d1161" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 560.386563] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.386946] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.387764] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 565.388159] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.389121] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.389121] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 575.391222] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 575.391222] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.391606] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 580.391606] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 580.404130] env[67003]: INFO networking_nsxv3.common.synchronization [None req-1649fd8d-fbc6-4dd1-8012-d9ba065cd031 None None] Enqueued Resource ID: 9d373e79-7ff5-46da-be9e-5d4e46f65c72 with Priority: HIGHEST for action port [ 580.404861] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d373e79-7ff5-46da-be9e-5d4e46f65c72 with Priority: HIGHEST for action port [ 580.405061] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d373e79-7ff5-46da-be9e-5d4e46f65c72 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.405188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d373e79-7ff5-46da-be9e-5d4e46f65c72" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.405254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d373e79-7ff5-46da-be9e-5d4e46f65c72" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.405968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d373e79-7ff5-46da-be9e-5d4e46f65c72" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.405968] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d373e79-7ff5-46da-be9e-5d4e46f65c72',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.909377] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d373e79-7ff5-46da-be9e-5d4e46f65c72 [ 580.910848] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.910848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.910848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.910848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.910848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.910848] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d373e79-7ff5-46da-be9e-5d4e46f65c72 already deleted. [ 580.910848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d373e79-7ff5-46da-be9e-5d4e46f65c72" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.987899] env[67003]: INFO networking_nsxv3.common.synchronization [None req-fae1912a-c8f4-44b1-ab02-2daf80822f69 None None] Enqueued Resource ID: a1f57d68-f931-4ae5-94f7-e168a7cf7571 with Priority: HIGHEST for action port [ 581.988171] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a1f57d68-f931-4ae5-94f7-e168a7cf7571 with Priority: HIGHEST for action port [ 581.988713] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-a1f57d68-f931-4ae5-94f7-e168a7cf7571 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.988835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a1f57d68-f931-4ae5-94f7-e168a7cf7571" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.988905] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a1f57d68-f931-4ae5-94f7-e168a7cf7571" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.990443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a1f57d68-f931-4ae5-94f7-e168a7cf7571" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.990542] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a1f57d68-f931-4ae5-94f7-e168a7cf7571',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.502579] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a1f57d68-f931-4ae5-94f7-e168a7cf7571 [ 582.502579] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.502579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.502579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.504641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.504641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.504641] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a1f57d68-f931-4ae5-94f7-e168a7cf7571 already deleted. [ 582.504641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a1f57d68-f931-4ae5-94f7-e168a7cf7571" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.772407] env[67003]: INFO networking_nsxv3.common.synchronization [None req-37cd580e-2eee-477a-8b8a-06990cb7fd22 None None] Enqueued Resource ID: ef659744-d89f-4a63-988f-5b6982d32309 with Priority: HIGHEST for action port [ 582.772636] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef659744-d89f-4a63-988f-5b6982d32309 with Priority: HIGHEST for action port [ 582.773218] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef659744-d89f-4a63-988f-5b6982d32309 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.773363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef659744-d89f-4a63-988f-5b6982d32309" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.773363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef659744-d89f-4a63-988f-5b6982d32309" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.774028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef659744-d89f-4a63-988f-5b6982d32309" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.774028] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef659744-d89f-4a63-988f-5b6982d32309',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.277422] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef659744-d89f-4a63-988f-5b6982d32309 [ 583.277748] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.277930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.277999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.278412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.278412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.278511] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef659744-d89f-4a63-988f-5b6982d32309 already deleted. [ 583.278556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef659744-d89f-4a63-988f-5b6982d32309" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.540800] env[67003]: INFO networking_nsxv3.common.synchronization [None req-78e442be-abfb-4aef-97d4-2a1080707bd7 None None] Enqueued Resource ID: 295b854c-bfe7-40de-8534-240eaec16dcf with Priority: HIGHEST for action port [ 584.540800] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 295b854c-bfe7-40de-8534-240eaec16dcf with Priority: HIGHEST for action port [ 584.540800] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-295b854c-bfe7-40de-8534-240eaec16dcf taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.540800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-295b854c-bfe7-40de-8534-240eaec16dcf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.540800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-295b854c-bfe7-40de-8534-240eaec16dcf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.541430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-295b854c-bfe7-40de-8534-240eaec16dcf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.541430] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('295b854c-bfe7-40de-8534-240eaec16dcf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.043448] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 295b854c-bfe7-40de-8534-240eaec16dcf [ 585.045335] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.045335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.045335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.045335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.045335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.045335] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:295b854c-bfe7-40de-8534-240eaec16dcf already deleted. [ 585.045335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-295b854c-bfe7-40de-8534-240eaec16dcf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.173094] env[67003]: INFO networking_nsxv3.common.synchronization [None req-6322f026-f985-44e3-a668-59d22ba32a00 None None] Enqueued Resource ID: efdfced9-f113-4d59-9cd8-382c0726e7fe with Priority: HIGHEST for action port [ 585.173421] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efdfced9-f113-4d59-9cd8-382c0726e7fe with Priority: HIGHEST for action port [ 585.173938] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-efdfced9-f113-4d59-9cd8-382c0726e7fe taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.174315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efdfced9-f113-4d59-9cd8-382c0726e7fe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.174315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efdfced9-f113-4d59-9cd8-382c0726e7fe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.174394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efdfced9-f113-4d59-9cd8-382c0726e7fe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.174454] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efdfced9-f113-4d59-9cd8-382c0726e7fe',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.676814] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port efdfced9-f113-4d59-9cd8-382c0726e7fe [ 585.677096] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.677160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.677209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.678397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.678397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.678397] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:efdfced9-f113-4d59-9cd8-382c0726e7fe already deleted. [ 585.678397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efdfced9-f113-4d59-9cd8-382c0726e7fe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.024919] env[67003]: INFO networking_nsxv3.common.synchronization [None req-7b51ca79-4d28-4cdc-a741-3f38e7302589 None None] Enqueued Resource ID: 92b8b600-89a0-4f80-a9fc-cd2fd44d268f with Priority: HIGHEST for action port [ 586.026152] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 92b8b600-89a0-4f80-a9fc-cd2fd44d268f with Priority: HIGHEST for action port [ 586.026857] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-92b8b600-89a0-4f80-a9fc-cd2fd44d268f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.026857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-92b8b600-89a0-4f80-a9fc-cd2fd44d268f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.026857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-92b8b600-89a0-4f80-a9fc-cd2fd44d268f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.027693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-92b8b600-89a0-4f80-a9fc-cd2fd44d268f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.027693] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('92b8b600-89a0-4f80-a9fc-cd2fd44d268f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.452021] env[67003]: INFO networking_nsxv3.common.synchronization [None req-37329926-0f24-4a3f-aa55-4c91ba2304cb None None] Enqueued Resource ID: b53839bb-8b2f-4f82-8d41-db98c24e3af0 with Priority: HIGHEST for action port [ 586.452021] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b53839bb-8b2f-4f82-8d41-db98c24e3af0 with Priority: HIGHEST for action port [ 586.452021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b53839bb-8b2f-4f82-8d41-db98c24e3af0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.452021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b53839bb-8b2f-4f82-8d41-db98c24e3af0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.452021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b53839bb-8b2f-4f82-8d41-db98c24e3af0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.452021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b53839bb-8b2f-4f82-8d41-db98c24e3af0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.452021] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b53839bb-8b2f-4f82-8d41-db98c24e3af0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.533678] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 92b8b600-89a0-4f80-a9fc-cd2fd44d268f [ 586.533921] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.534072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.534144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.534350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.535348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.535469] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:92b8b600-89a0-4f80-a9fc-cd2fd44d268f already deleted. [ 586.535570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-92b8b600-89a0-4f80-a9fc-cd2fd44d268f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.912399] env[67003]: INFO networking_nsxv3.common.synchronization [None req-3d3d7798-5ca0-48d7-b4b5-a18faee181ae None None] Enqueued Resource ID: 88a79583-11c2-4ee0-87ce-9cf353a1b40e with Priority: HIGHEST for action port [ 586.913844] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88a79583-11c2-4ee0-87ce-9cf353a1b40e with Priority: HIGHEST for action port [ 586.914251] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-88a79583-11c2-4ee0-87ce-9cf353a1b40e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.914387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88a79583-11c2-4ee0-87ce-9cf353a1b40e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.914450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88a79583-11c2-4ee0-87ce-9cf353a1b40e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.914676] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88a79583-11c2-4ee0-87ce-9cf353a1b40e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.914749] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88a79583-11c2-4ee0-87ce-9cf353a1b40e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.955419] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b53839bb-8b2f-4f82-8d41-db98c24e3af0 [ 586.955419] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.955419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.955419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.955419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.955419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.955419] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b53839bb-8b2f-4f82-8d41-db98c24e3af0 already deleted. [ 586.955419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b53839bb-8b2f-4f82-8d41-db98c24e3af0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.417095] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88a79583-11c2-4ee0-87ce-9cf353a1b40e [ 587.417486] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.417486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.417615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.417722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.417803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.417895] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88a79583-11c2-4ee0-87ce-9cf353a1b40e already deleted. [ 587.417974] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88a79583-11c2-4ee0-87ce-9cf353a1b40e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.464848] env[67003]: INFO networking_nsxv3.common.synchronization [None req-880b67b3-78c8-4a10-8db6-d4b7b3441b1d None None] Enqueued Resource ID: ef2cd49a-50e1-420c-8fd1-8cfb60911113 with Priority: HIGHEST for action port [ 587.465134] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef2cd49a-50e1-420c-8fd1-8cfb60911113 with Priority: HIGHEST for action port [ 587.465446] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef2cd49a-50e1-420c-8fd1-8cfb60911113 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.465562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef2cd49a-50e1-420c-8fd1-8cfb60911113" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.465627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef2cd49a-50e1-420c-8fd1-8cfb60911113" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.465857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef2cd49a-50e1-420c-8fd1-8cfb60911113" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.465961] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef2cd49a-50e1-420c-8fd1-8cfb60911113',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.970759] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef2cd49a-50e1-420c-8fd1-8cfb60911113 [ 587.971074] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.971187] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.971243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.972045] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.972045] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.972045] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef2cd49a-50e1-420c-8fd1-8cfb60911113 already deleted. [ 587.972045] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef2cd49a-50e1-420c-8fd1-8cfb60911113" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.154087] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e7470bee-f07c-4008-8820-84f5f3b99f90 None None] Enqueued Resource ID: e605509a-f602-4514-967b-acc5aaf74e99 with Priority: HIGHEST for action port [ 588.154087] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e605509a-f602-4514-967b-acc5aaf74e99 with Priority: HIGHEST for action port [ 588.154087] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-e605509a-f602-4514-967b-acc5aaf74e99 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.154087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e605509a-f602-4514-967b-acc5aaf74e99" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.154087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e605509a-f602-4514-967b-acc5aaf74e99" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.154087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e605509a-f602-4514-967b-acc5aaf74e99" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.154087] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e605509a-f602-4514-967b-acc5aaf74e99',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.426654] env[67003]: INFO networking_nsxv3.common.synchronization [None req-b035ad67-46e5-4b56-a9b7-882641599e7a None None] Enqueued Resource ID: ef003385-fad0-4cee-aeb1-0cb0ab3dec0b with Priority: HIGHEST for action port [ 588.427639] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef003385-fad0-4cee-aeb1-0cb0ab3dec0b with Priority: HIGHEST for action port [ 588.428072] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef003385-fad0-4cee-aeb1-0cb0ab3dec0b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.428336] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef003385-fad0-4cee-aeb1-0cb0ab3dec0b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.428443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef003385-fad0-4cee-aeb1-0cb0ab3dec0b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.429142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef003385-fad0-4cee-aeb1-0cb0ab3dec0b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.429271] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef003385-fad0-4cee-aeb1-0cb0ab3dec0b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.656918] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e605509a-f602-4514-967b-acc5aaf74e99 [ 588.657163] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.657287] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.657355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.657602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.657776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.657876] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e605509a-f602-4514-967b-acc5aaf74e99 already deleted. [ 588.657954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e605509a-f602-4514-967b-acc5aaf74e99" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.932433] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef003385-fad0-4cee-aeb1-0cb0ab3dec0b [ 588.932694] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.932809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.932852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.933078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.933180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.933254] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef003385-fad0-4cee-aeb1-0cb0ab3dec0b already deleted. [ 588.933509] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef003385-fad0-4cee-aeb1-0cb0ab3dec0b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.302630] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ddb2b09c-cf4d-4e01-abe5-db0be2fc2849 None None] Enqueued Resource ID: ef7d9651-2e79-4647-90f5-3197424ccd7f with Priority: HIGHEST for action port [ 589.303633] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef7d9651-2e79-4647-90f5-3197424ccd7f with Priority: HIGHEST for action port [ 589.304114] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef7d9651-2e79-4647-90f5-3197424ccd7f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.304251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef7d9651-2e79-4647-90f5-3197424ccd7f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.304350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef7d9651-2e79-4647-90f5-3197424ccd7f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.304567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef7d9651-2e79-4647-90f5-3197424ccd7f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.304650] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef7d9651-2e79-4647-90f5-3197424ccd7f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.809413] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef7d9651-2e79-4647-90f5-3197424ccd7f [ 589.809657] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.809791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.809862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.810107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.810202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.810367] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef7d9651-2e79-4647-90f5-3197424ccd7f already deleted. [ 589.810428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef7d9651-2e79-4647-90f5-3197424ccd7f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.914456] env[67003]: INFO networking_nsxv3.common.synchronization [None req-37a43438-f9af-4476-834b-2169a64523f4 None None] Enqueued Resource ID: dcbdf5b5-cf78-4635-8233-91e66ed6d266 with Priority: HIGHEST for action port [ 590.914456] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcbdf5b5-cf78-4635-8233-91e66ed6d266 with Priority: HIGHEST for action port [ 590.915088] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcbdf5b5-cf78-4635-8233-91e66ed6d266 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.915088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcbdf5b5-cf78-4635-8233-91e66ed6d266" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.915088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcbdf5b5-cf78-4635-8233-91e66ed6d266" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.916208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcbdf5b5-cf78-4635-8233-91e66ed6d266" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.916208] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcbdf5b5-cf78-4635-8233-91e66ed6d266',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.926290] env[67003]: INFO networking_nsxv3.common.synchronization [None req-4ab622f9-976a-471b-b380-f7470a9fb7d5 None None] Enqueued Resource ID: 9041db45-ca75-4907-b52c-590852814635 with Priority: HIGHEST for action port [ 590.926290] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9041db45-ca75-4907-b52c-590852814635 with Priority: HIGHEST for action port [ 590.926893] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-9041db45-ca75-4907-b52c-590852814635 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.926893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9041db45-ca75-4907-b52c-590852814635" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.926893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9041db45-ca75-4907-b52c-590852814635" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.928147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9041db45-ca75-4907-b52c-590852814635" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.928395] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9041db45-ca75-4907-b52c-590852814635',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.419283] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dcbdf5b5-cf78-4635-8233-91e66ed6d266 [ 591.419530] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.419671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.419742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.420031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.420113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.420149] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dcbdf5b5-cf78-4635-8233-91e66ed6d266 already deleted. [ 591.420214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcbdf5b5-cf78-4635-8233-91e66ed6d266" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.432231] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9041db45-ca75-4907-b52c-590852814635 [ 591.432231] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.432231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.432231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.432373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.432373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.432458] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9041db45-ca75-4907-b52c-590852814635 already deleted. [ 591.432551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9041db45-ca75-4907-b52c-590852814635" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.670810] env[67003]: INFO networking_nsxv3.common.synchronization [None req-17b05da1-e8c6-4eaf-a6e2-24fa74feed0c None None] Enqueued Resource ID: 5bad66df-55b5-4275-bc30-b293766f3652 with Priority: HIGHEST for action port [ 592.670810] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bad66df-55b5-4275-bc30-b293766f3652 with Priority: HIGHEST for action port [ 592.670810] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bad66df-55b5-4275-bc30-b293766f3652 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.670810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bad66df-55b5-4275-bc30-b293766f3652" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.671438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bad66df-55b5-4275-bc30-b293766f3652" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.671826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bad66df-55b5-4275-bc30-b293766f3652" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.672062] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bad66df-55b5-4275-bc30-b293766f3652',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.176527] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5bad66df-55b5-4275-bc30-b293766f3652 [ 593.177538] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.177538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.177538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.177538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.177538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.177538] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5bad66df-55b5-4275-bc30-b293766f3652 already deleted. [ 593.177538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bad66df-55b5-4275-bc30-b293766f3652" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.193388] env[67003]: INFO networking_nsxv3.common.synchronization [None req-c67df039-cfc0-47ab-a8a7-58937ca4194c None None] Enqueued Resource ID: 825df373-facf-4eba-884f-8c15d07417d7 with Priority: HIGHEST for action port [ 593.193637] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 825df373-facf-4eba-884f-8c15d07417d7 with Priority: HIGHEST for action port [ 593.194369] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-825df373-facf-4eba-884f-8c15d07417d7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.194369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-825df373-facf-4eba-884f-8c15d07417d7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.194528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-825df373-facf-4eba-884f-8c15d07417d7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.194660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-825df373-facf-4eba-884f-8c15d07417d7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.194738] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('825df373-facf-4eba-884f-8c15d07417d7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.698306] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 825df373-facf-4eba-884f-8c15d07417d7 [ 593.698752] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.698752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.698752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.699302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.699302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.699302] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:825df373-facf-4eba-884f-8c15d07417d7 already deleted. [ 593.699302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-825df373-facf-4eba-884f-8c15d07417d7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.025910] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e8806395-26ae-4fa5-b816-66e2de6cf69b None None] Enqueued Resource ID: 0948ee44-8a2a-48f1-a0e4-33e5d12e1cbd with Priority: HIGHEST for action port [ 595.026432] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0948ee44-8a2a-48f1-a0e4-33e5d12e1cbd with Priority: HIGHEST for action port [ 595.026855] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0948ee44-8a2a-48f1-a0e4-33e5d12e1cbd taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.026855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0948ee44-8a2a-48f1-a0e4-33e5d12e1cbd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.027019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0948ee44-8a2a-48f1-a0e4-33e5d12e1cbd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.027218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0948ee44-8a2a-48f1-a0e4-33e5d12e1cbd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.027925] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0948ee44-8a2a-48f1-a0e4-33e5d12e1cbd',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.061900] env[67003]: INFO networking_nsxv3.common.synchronization [None req-6f74d5a5-1d7a-4392-8c36-8de156eaf5c8 None None] Enqueued Resource ID: d504ec7e-b9d8-479e-aea5-0b16c5b4adac with Priority: HIGHEST for action port [ 595.061900] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d504ec7e-b9d8-479e-aea5-0b16c5b4adac with Priority: HIGHEST for action port [ 595.061900] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d504ec7e-b9d8-479e-aea5-0b16c5b4adac taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.061900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d504ec7e-b9d8-479e-aea5-0b16c5b4adac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.061900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d504ec7e-b9d8-479e-aea5-0b16c5b4adac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.061900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d504ec7e-b9d8-479e-aea5-0b16c5b4adac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.061900] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d504ec7e-b9d8-479e-aea5-0b16c5b4adac',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.531660] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0948ee44-8a2a-48f1-a0e4-33e5d12e1cbd [ 595.531952] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.531952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.532087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.533236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.533236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.533236] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0948ee44-8a2a-48f1-a0e4-33e5d12e1cbd already deleted. [ 595.533236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0948ee44-8a2a-48f1-a0e4-33e5d12e1cbd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.566792] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d504ec7e-b9d8-479e-aea5-0b16c5b4adac [ 595.566792] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.566792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.566792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.566792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.566792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.566792] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d504ec7e-b9d8-479e-aea5-0b16c5b4adac already deleted. [ 595.566792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d504ec7e-b9d8-479e-aea5-0b16c5b4adac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.315174] env[67003]: INFO networking_nsxv3.common.synchronization [None req-7b0ddb5b-1330-42c9-b667-19e04d71b498 None None] Enqueued Resource ID: 4aa10334-0154-40b9-9812-784d0139f39d with Priority: HIGHEST for action port [ 596.315408] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aa10334-0154-40b9-9812-784d0139f39d with Priority: HIGHEST for action port [ 596.317304] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-4aa10334-0154-40b9-9812-784d0139f39d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.317304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4aa10334-0154-40b9-9812-784d0139f39d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.317304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4aa10334-0154-40b9-9812-784d0139f39d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.319815] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4aa10334-0154-40b9-9812-784d0139f39d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.319906] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4aa10334-0154-40b9-9812-784d0139f39d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.705405] env[67003]: INFO networking_nsxv3.common.synchronization [req-1bc291db-4c22-4b6f-89e9-ae92cf292c42 req-1cb0855f-7940-4148-ab22-ea02301196e1 tempest-TenantUsagesTestJSON-1385717003 tempest-TenantUsagesTestJSON-1385717003-project-member] Enqueued Resource ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 with Priority: HIGHEST for action security_group_members [ 596.705704] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 with Priority: HIGHEST for action security_group_members [ 596.706433] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-43ab13f3-ab08-40ca-8026-84efbca23b63 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.706683] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.706762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.707014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.707192] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.707293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.707357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.707503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.707589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.707769] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43ab13f3-ab08-40ca-8026-84efbca23b63',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.823054] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4aa10334-0154-40b9-9812-784d0139f39d [ 596.823284] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.823420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.823923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.823923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.823923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.823923] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4aa10334-0154-40b9-9812-784d0139f39d already deleted. [ 596.824090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4aa10334-0154-40b9-9812-784d0139f39d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.210845] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.211454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.211454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.211454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.211454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.211620] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.211724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.211759] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.211909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.211973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.212072] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 already deleted. [ 597.212151] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.400653] env[67003]: INFO networking_nsxv3.common.synchronization [None req-f44589bc-efdf-4d93-80bc-7991a88c9fe5 None None] Enqueued Resource ID: 1337795c-93c6-4bca-b9f2-1717d074b807 with Priority: HIGHEST for action port [ 597.403608] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1337795c-93c6-4bca-b9f2-1717d074b807 with Priority: HIGHEST for action port [ 597.403608] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-1337795c-93c6-4bca-b9f2-1717d074b807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.403608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1337795c-93c6-4bca-b9f2-1717d074b807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.403608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1337795c-93c6-4bca-b9f2-1717d074b807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.403608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1337795c-93c6-4bca-b9f2-1717d074b807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.403608] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1337795c-93c6-4bca-b9f2-1717d074b807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.772028] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.772028] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.772028] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.772028] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.772028] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.774988] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.775160] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.775401] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.775547] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.775833] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.775960] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.776650] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.776650] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.776650] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.776650] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.776650] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.797144] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.797322] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.797455] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.797686] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.798135] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-b7f119c7-b69e-42dc-b340-c192a1ff15c3 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.799260] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-b7f119c7-b69e-42dc-b340-c192a1ff15c3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.799402] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-b7f119c7-b69e-42dc-b340-c192a1ff15c3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.800020] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-b7f119c7-b69e-42dc-b340-c192a1ff15c3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.800020] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7f119c7-b69e-42dc-b340-c192a1ff15c3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.905988] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1337795c-93c6-4bca-b9f2-1717d074b807 [ 597.906285] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.906436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.906517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.906718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.906809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.906904] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1337795c-93c6-4bca-b9f2-1717d074b807 already deleted. [ 597.906986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1337795c-93c6-4bca-b9f2-1717d074b807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.305565] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.305565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.305565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.305565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.305565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.305565] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port b7f119c7-b69e-42dc-b340-c192a1ff15c3 not found, creating... [ 598.305565] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.305565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.305565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.305565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.305565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.305999] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.305999] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.305999] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.306859] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.306859] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.306859] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: b7f119c7-b69e-42dc-b340-c192a1ff15c3 is going to be created. [ 598.329668] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.329837] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.329880] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.330960] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.330960] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.330960] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-b7f119c7-b69e-42dc-b340-c192a1ff15c3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.380830] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ea148a9-c439-4c54-a56f-e6528c005482 req-e8010ed8-eaf3-44f4-adaa-17316b138e8c tempest-DeleteServersAdminTestJSON-1035837237 tempest-DeleteServersAdminTestJSON-1035837237-project-member] Enqueued Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_members [ 598.381528] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_members [ 598.382065] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.382173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.382242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.382514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.382667] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.382774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.382839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.382989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.383094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.383189] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.684203] env[67003]: INFO networking_nsxv3.common.synchronization [None req-af30f20e-36f7-4bd6-b3f6-1096428b4cdd None None] Enqueued Resource ID: 21e50b4a-c770-48fb-ac29-262dbfa337b6 with Priority: HIGHEST for action port [ 598.684458] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21e50b4a-c770-48fb-ac29-262dbfa337b6 with Priority: HIGHEST for action port [ 598.685117] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-21e50b4a-c770-48fb-ac29-262dbfa337b6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.685419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21e50b4a-c770-48fb-ac29-262dbfa337b6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.685419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21e50b4a-c770-48fb-ac29-262dbfa337b6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.685534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21e50b4a-c770-48fb-ac29-262dbfa337b6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.685609] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21e50b4a-c770-48fb-ac29-262dbfa337b6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.885471] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.885471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.885471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.885734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.885734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.885872] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.885969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.886046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.886197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.886272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.886356] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 already deleted. [ 598.886452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.887854] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.888046] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.888156] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.888371] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.888614] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.888758] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.888865] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.889077] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.889210] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.889403] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.889510] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.889616] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.889724] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.889830] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.889933] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.890068] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.909521] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.909691] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.909861] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.909992] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.910638] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-ca0a5316-2149-46f4-b50a-2d9b628ebfdb taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.910838] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-ca0a5316-2149-46f4-b50a-2d9b628ebfdb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.910959] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-ca0a5316-2149-46f4-b50a-2d9b628ebfdb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.911281] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-ca0a5316-2149-46f4-b50a-2d9b628ebfdb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.911419] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca0a5316-2149-46f4-b50a-2d9b628ebfdb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.120956] env[67003]: INFO networking_nsxv3.common.synchronization [req-1bc291db-4c22-4b6f-89e9-ae92cf292c42 req-1c488f12-b901-4f4f-9e7f-f504af91a628 service nova] Enqueued Resource ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 with Priority: HIGHEST for action security_group_rules [ 599.121185] env[67003]: INFO networking_nsxv3.common.synchronization [req-1bc291db-4c22-4b6f-89e9-ae92cf292c42 req-1c488f12-b901-4f4f-9e7f-f504af91a628 service nova] Enqueued Resource ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 with Priority: HIGHEST for action security_group_members [ 599.121363] env[67003]: INFO networking_nsxv3.common.synchronization [req-1bc291db-4c22-4b6f-89e9-ae92cf292c42 req-1c488f12-b901-4f4f-9e7f-f504af91a628 service nova] Enqueued Resource ID: b7f119c7-b69e-42dc-b340-c192a1ff15c3 with Priority: HIGHEST for action port [ 599.122182] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 with Priority: HIGHEST for action security_group_rules [ 599.122293] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 with Priority: HIGHEST for action security_group_members [ 599.122556] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7f119c7-b69e-42dc-b340-c192a1ff15c3 with Priority: HIGHEST for action port [ 599.122862] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43ab13f3-ab08-40ca-8026-84efbca23b63 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.122862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.122955] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.123598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.123598] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43ab13f3-ab08-40ca-8026-84efbca23b63',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.124230] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-43ab13f3-ab08-40ca-8026-84efbca23b63 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.124353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.124423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.124875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.125078] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.125183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.126049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.126049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.126049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.126049] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43ab13f3-ab08-40ca-8026-84efbca23b63',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.126934] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7f119c7-b69e-42dc-b340-c192a1ff15c3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.127061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7f119c7-b69e-42dc-b340-c192a1ff15c3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.127126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7f119c7-b69e-42dc-b340-c192a1ff15c3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.127924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7f119c7-b69e-42dc-b340-c192a1ff15c3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.127995] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7f119c7-b69e-42dc-b340-c192a1ff15c3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.188631] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 21e50b4a-c770-48fb-ac29-262dbfa337b6 [ 599.188883] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.189041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.189119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.189355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.189900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.189900] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:21e50b4a-c770-48fb-ac29-262dbfa337b6 already deleted. [ 599.189900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21e50b4a-c770-48fb-ac29-262dbfa337b6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.415504] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.415734] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.415864] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.416651] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.416651] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.416651] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port ca0a5316-2149-46f4-b50a-2d9b628ebfdb not found, creating... [ 599.416795] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.416924] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.417057] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.417241] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.417375] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.417682] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.417894] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.417982] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.418190] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.418316] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.418452] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: ca0a5316-2149-46f4-b50a-2d9b628ebfdb is going to be created. [ 599.441827] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.442052] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.442052] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.442375] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.442600] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.442844] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-ca0a5316-2149-46f4-b50a-2d9b628ebfdb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.634179] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-43ab13f3-ab08-40ca-8026-84efbca23b63 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.634373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.648095] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('43ab13f3-ab08-40ca-8026-84efbca23b63',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.652841] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7f119c7-b69e-42dc-b340-c192a1ff15c3 with status ACTIVE [ 599.652841] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.652841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.652841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.652841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.652841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.652841] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.652841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.652841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.652841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.653671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.653808] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.653921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.653983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.654157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.654242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.654315] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7f119c7-b69e-42dc-b340-c192a1ff15c3 is going to be updated. [ 599.677822] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.678028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.678095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.678289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.678426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.678584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7f119c7-b69e-42dc-b340-c192a1ff15c3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.054528] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e8240e0e-ca8e-4413-96e5-5bd7b2f99eb2 None None] Enqueued Resource ID: 663f91dd-c573-46bb-9e6d-7d0e0b7206fa with Priority: HIGHEST for action port [ 600.054953] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 663f91dd-c573-46bb-9e6d-7d0e0b7206fa with Priority: HIGHEST for action port [ 600.055278] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-663f91dd-c573-46bb-9e6d-7d0e0b7206fa taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.055385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-663f91dd-c573-46bb-9e6d-7d0e0b7206fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.055451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-663f91dd-c573-46bb-9e6d-7d0e0b7206fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.055694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-663f91dd-c573-46bb-9e6d-7d0e0b7206fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.056655] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('663f91dd-c573-46bb-9e6d-7d0e0b7206fa',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.141036] env[67003]: INFO networking_nsxv3.common.synchronization [None req-97e9ff34-489c-4255-9492-b39a268b2700 None None] Enqueued Resource ID: 9ce89ae2-90e0-4876-915f-3e962ff85e0a with Priority: HIGHEST for action port [ 600.141297] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce89ae2-90e0-4876-915f-3e962ff85e0a with Priority: HIGHEST for action port [ 600.141623] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ce89ae2-90e0-4876-915f-3e962ff85e0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.141763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ce89ae2-90e0-4876-915f-3e962ff85e0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.141831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ce89ae2-90e0-4876-915f-3e962ff85e0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.142729] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ce89ae2-90e0-4876-915f-3e962ff85e0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.142941] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ce89ae2-90e0-4876-915f-3e962ff85e0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.156286] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('43ab13f3-ab08-40ca-8026-84efbca23b63',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.348383] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ea148a9-c439-4c54-a56f-e6528c005482 req-c9f6f223-8444-45f9-9263-bb60c97eba63 service nova] Enqueued Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_rules [ 600.349032] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ea148a9-c439-4c54-a56f-e6528c005482 req-c9f6f223-8444-45f9-9263-bb60c97eba63 service nova] Enqueued Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_members [ 600.349032] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ea148a9-c439-4c54-a56f-e6528c005482 req-c9f6f223-8444-45f9-9263-bb60c97eba63 service nova] Enqueued Resource ID: ca0a5316-2149-46f4-b50a-2d9b628ebfdb with Priority: HIGHEST for action port [ 600.349254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_rules [ 600.349373] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_members [ 600.349467] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca0a5316-2149-46f4-b50a-2d9b628ebfdb with Priority: HIGHEST for action port [ 600.349731] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.349851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.349918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.350362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.350457] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.351609] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.351609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.351609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.351803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.351803] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.351901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.351960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.352113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.352412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.352641] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.353509] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca0a5316-2149-46f4-b50a-2d9b628ebfdb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.353620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca0a5316-2149-46f4-b50a-2d9b628ebfdb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.353696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca0a5316-2149-46f4-b50a-2d9b628ebfdb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.354154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca0a5316-2149-46f4-b50a-2d9b628ebfdb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.354290] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca0a5316-2149-46f4-b50a-2d9b628ebfdb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.558695] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 663f91dd-c573-46bb-9e6d-7d0e0b7206fa [ 600.558937] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.559073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.559173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.559357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.559448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.559550] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:663f91dd-c573-46bb-9e6d-7d0e0b7206fa already deleted. [ 600.559642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-663f91dd-c573-46bb-9e6d-7d0e0b7206fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.647667] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ce89ae2-90e0-4876-915f-3e962ff85e0a [ 600.647888] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.648044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.648126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.648308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.648397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.648491] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ce89ae2-90e0-4876-915f-3e962ff85e0a already deleted. [ 600.648609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ce89ae2-90e0-4876-915f-3e962ff85e0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.658070] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.658225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.658225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.658449] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.658514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.658607] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 is going to be created. [ 600.687492] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.687710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.687710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.687937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.688055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.699614] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 in Status: UNINITIALIZED for 2s [ 600.823421] env[67003]: INFO networking_nsxv3.common.synchronization [req-1a94227b-7b69-4c03-90b2-1f23faa1714d req-ca0c3090-5a8d-4762-b055-0fd34450e051 tempest-FloatingIPsAssociationNegativeTestJSON-933496267 tempest-FloatingIPsAssociationNegativeTestJSON-933496267-project-member] Enqueued Resource ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 with Priority: HIGHEST for action security_group_members [ 600.824254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 with Priority: HIGHEST for action security_group_members [ 600.824414] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.824591] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.824650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.824852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.825441] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.825441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.825441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.825441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.825683] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.825683] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8df0b4b9-9305-44fa-8ffb-138abad7c0b5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.857363] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.857495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.858124] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.858488] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ca0a5316-2149-46f4-b50a-2d9b628ebfdb with status ACTIVE [ 600.858677] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.858814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.858864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.859392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.859457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.859595] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.859862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.859924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.860246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.860280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.860479] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.860589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.860974] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.861172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.861251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.861539] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ca0a5316-2149-46f4-b50a-2d9b628ebfdb is going to be updated. [ 600.887500] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.887500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.887500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.887500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.887500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.887500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca0a5316-2149-46f4-b50a-2d9b628ebfdb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.317264] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-550 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.317561] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-550" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.317609] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-550" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.317926] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-550" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.318258] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.318583] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.318873] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.319052] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.319228] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.319869] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.320014] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 601.320130] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 601.320259] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 601.320378] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 601.320553] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 601.320871] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 601.328626] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.328626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.328626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.328975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.329158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.329279] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.329469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.329557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.329763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.329868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.329981] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 already deleted. [ 601.330102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.343159] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 601.343342] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 601.343458] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 601.343754] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-550" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.343953] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-91f8db51-479b-474c-8662-ec4a7bb5ede5 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.344210] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-91f8db51-479b-474c-8662-ec4a7bb5ede5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.344278] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-91f8db51-479b-474c-8662-ec4a7bb5ede5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.344674] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-91f8db51-479b-474c-8662-ec4a7bb5ede5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.344813] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91f8db51-479b-474c-8662-ec4a7bb5ede5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.365097] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.847629] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.847860] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.848017] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.848632] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.848632] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.848632] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 91f8db51-479b-474c-8662-ec4a7bb5ede5 not found, creating... [ 601.848885] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.849040] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.849089] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.849304] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.849430] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.850050] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.850050] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.851216] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.851216] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.851216] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.851216] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 91f8db51-479b-474c-8662-ec4a7bb5ede5 is going to be created. [ 601.870533] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.870819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.870819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.870990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.871096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.871211] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 is going to be created. [ 601.874196] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.874383] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.874504] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.874793] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.875059] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.875887] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-91f8db51-479b-474c-8662-ec4a7bb5ede5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.906741] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.907070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.907070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.908147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.908147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.918099] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: UNINITIALIZED for 2s [ 601.931020] env[67003]: INFO networking_nsxv3.common.synchronization [None req-cf3c5f06-02d6-4039-9bae-f02f6ab25f45 None None] Enqueued Resource ID: 29c3755f-8d33-4799-a0ad-856785a27f51 with Priority: HIGHEST for action port [ 601.931020] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29c3755f-8d33-4799-a0ad-856785a27f51 with Priority: HIGHEST for action port [ 601.931020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-29c3755f-8d33-4799-a0ad-856785a27f51 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.931020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29c3755f-8d33-4799-a0ad-856785a27f51" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.931020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29c3755f-8d33-4799-a0ad-856785a27f51" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.931020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29c3755f-8d33-4799-a0ad-856785a27f51" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.931020] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29c3755f-8d33-4799-a0ad-856785a27f51',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.434575] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29c3755f-8d33-4799-a0ad-856785a27f51 [ 602.434851] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.434966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.435048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.435266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.435986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.435986] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29c3755f-8d33-4799-a0ad-856785a27f51 already deleted. [ 602.435986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29c3755f-8d33-4799-a0ad-856785a27f51" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.663983] env[67003]: INFO networking_nsxv3.common.synchronization [req-1a94227b-7b69-4c03-90b2-1f23faa1714d req-3d7763d3-eca0-4872-b6c8-c0bdca6ec2d7 service nova] Enqueued Resource ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 with Priority: HIGHEST for action security_group_rules [ 602.664262] env[67003]: INFO networking_nsxv3.common.synchronization [req-1a94227b-7b69-4c03-90b2-1f23faa1714d req-3d7763d3-eca0-4872-b6c8-c0bdca6ec2d7 service nova] Enqueued Resource ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 with Priority: HIGHEST for action security_group_members [ 602.665152] env[67003]: INFO networking_nsxv3.common.synchronization [req-1a94227b-7b69-4c03-90b2-1f23faa1714d req-3d7763d3-eca0-4872-b6c8-c0bdca6ec2d7 service nova] Enqueued Resource ID: 91f8db51-479b-474c-8662-ec4a7bb5ede5 with Priority: HIGHEST for action port [ 602.665152] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 with Priority: HIGHEST for action security_group_rules [ 602.665698] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 with Priority: HIGHEST for action security_group_members [ 602.665927] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91f8db51-479b-474c-8662-ec4a7bb5ede5 with Priority: HIGHEST for action port [ 602.666270] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8df0b4b9-9305-44fa-8ffb-138abad7c0b5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.668383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.668383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.668383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.668383] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8df0b4b9-9305-44fa-8ffb-138abad7c0b5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.668780] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.669489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.669615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.669808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.669972] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.670092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.670826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.670826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.670826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.670826] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8df0b4b9-9305-44fa-8ffb-138abad7c0b5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.671277] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-91f8db51-479b-474c-8662-ec4a7bb5ede5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.671438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91f8db51-479b-474c-8662-ec4a7bb5ede5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.671532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91f8db51-479b-474c-8662-ec4a7bb5ede5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.671696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91f8db51-479b-474c-8662-ec4a7bb5ede5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.671775] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91f8db51-479b-474c-8662-ec4a7bb5ede5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.710397] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 in Status: SUCCESS [ 602.710687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.710848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.711080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.711284] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.711386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.711492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.711596] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.712493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.712493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.712493] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('43ab13f3-ab08-40ca-8026-84efbca23b63',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.880861] env[67003]: INFO networking_nsxv3.common.synchronization [None req-80fae59b-2e0d-436b-99d6-e544d29d8d34 None None] Enqueued Resource ID: 9a2fa56a-5ff8-48c4-a96f-3161f2a40dba with Priority: HIGHEST for action port [ 602.881423] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a2fa56a-5ff8-48c4-a96f-3161f2a40dba with Priority: HIGHEST for action port [ 602.882137] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a2fa56a-5ff8-48c4-a96f-3161f2a40dba taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.882268] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a2fa56a-5ff8-48c4-a96f-3161f2a40dba" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.882330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a2fa56a-5ff8-48c4-a96f-3161f2a40dba" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.882714] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a2fa56a-5ff8-48c4-a96f-3161f2a40dba" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.882812] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a2fa56a-5ff8-48c4-a96f-3161f2a40dba',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.138185] env[67003]: INFO networking_nsxv3.common.synchronization [req-976ce1c4-71a4-40da-b5f8-e294f6a125f7 req-293d1a21-7a5c-49ab-9966-a6a994c85fbe tempest-ImagesOneServerNegativeTestJSON-533995407 tempest-ImagesOneServerNegativeTestJSON-533995407-project-member] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 603.138703] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 603.138999] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.139417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.139523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.141258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.141447] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.141561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.141624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.141803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.141925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.141982] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.173960] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8df0b4b9-9305-44fa-8ffb-138abad7c0b5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.175425] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.175539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.175905] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91f8db51-479b-474c-8662-ec4a7bb5ede5 with status ACTIVE [ 603.176093] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.176210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.179341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.179341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.179341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.179341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.179341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.179341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.179341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.179341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.179341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.179341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.179341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.179341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.179341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.179341] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91f8db51-479b-474c-8662-ec4a7bb5ede5 is going to be updated. [ 603.200468] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.200558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.200821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.200821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.201025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.201242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91f8db51-479b-474c-8662-ec4a7bb5ede5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.214485] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-43ab13f3-ab08-40ca-8026-84efbca23b63 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.214579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.214655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.215047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.215047] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.215931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.215931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.215931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.216790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.216989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.217075] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-43ab13f3-ab08-40ca-8026-84efbca23b63 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.217423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.217423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.217423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.217548] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.217962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.217962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.217962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.217962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.217962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.218239] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('43ab13f3-ab08-40ca-8026-84efbca23b63',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.384992] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9a2fa56a-5ff8-48c4-a96f-3161f2a40dba [ 603.385485] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.385485] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.385596] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.385729] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.385808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.385902] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9a2fa56a-5ff8-48c4-a96f-3161f2a40dba already deleted. [ 603.386066] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a2fa56a-5ff8-48c4-a96f-3161f2a40dba" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.645312] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.645312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.645312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.645312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.645312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.645312] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.645312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.645312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.645312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.645312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.645312] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a already deleted. [ 603.645312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.677042] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8df0b4b9-9305-44fa-8ffb-138abad7c0b5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.702545] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-784 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.702802] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-784" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.702925] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-784" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.703272] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-784" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.703534] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.703711] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.703859] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.704370] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.704602] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.704875] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.705055] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.705206] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.705331] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.705491] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.705616] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.706457] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.720376] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 43ab13f3-ab08-40ca-8026-84efbca23b63: rpc.has_security_group_logging(os_id): False [ 603.733486] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.733685] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.733887] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.734048] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-784" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.734426] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-9eb880c1-0152-4ec0-aca1-327a0acac117 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.734612] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-9eb880c1-0152-4ec0-aca1-327a0acac117" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.734741] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-9eb880c1-0152-4ec0-aca1-327a0acac117" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.735068] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-9eb880c1-0152-4ec0-aca1-327a0acac117" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.735208] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9eb880c1-0152-4ec0-aca1-327a0acac117',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.743019] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.743019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.743019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.743019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.743019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.743019] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.743019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.743019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.743019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.743019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.743019] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.743549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.743549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.743549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.743549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.743736] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.743900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.743939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.744134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.744221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.744346] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 is going to be created. [ 603.820626] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.820841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.820891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.821193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.821325] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.833845] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 in Status: IN_PROGRESS for 2s [ 603.931056] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: SUCCESS [ 603.931056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.931056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.931056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.931056] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.931279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.931279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.931372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.931497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.931590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.931651] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.182365] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.182689] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.182828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.183062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.183155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.183258] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 is going to be created. [ 604.212262] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.212428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.212533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.212852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.213822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.224269] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 in Status: UNINITIALIZED for 2s [ 604.239133] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.239364] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.239487] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.239758] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.239902] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.240064] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 9eb880c1-0152-4ec0-aca1-327a0acac117 not found, creating... [ 604.240323] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.240889] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.240889] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.240889] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.241026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.241248] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.241399] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.241511] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.241711] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.241838] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.241969] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 9eb880c1-0152-4ec0-aca1-327a0acac117 is going to be created. [ 604.261949] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.262213] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.262299] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.262552] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.262860] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.263181] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-9eb880c1-0152-4ec0-aca1-327a0acac117" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.434748] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.434886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.434966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.435199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.435367] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.435472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.435536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.435685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.435780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.435867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.436026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.436124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.436184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.436322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.436456] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.436547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.436607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.436740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.436814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.436893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.436986] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.939561] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8411bfa0-87b0-49a2-a1eb-a535d9d88274: rpc.has_security_group_logging(os_id): False [ 604.959419] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.959648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.959745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.960037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.960163] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.960434] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.960540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.960629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.960774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.961303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.961303] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.961303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.961303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.961512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.961512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.961725] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.961839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.961898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.962042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.962122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.962207] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 is going to be created. [ 604.969713] env[67003]: INFO networking_nsxv3.common.synchronization [None req-acdff135-6a7a-4e07-a72d-cc153364a4b1 None None] Enqueued Resource ID: ec29d907-7e62-4499-842c-041b6b27eae6 with Priority: HIGHEST for action port [ 604.970361] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec29d907-7e62-4499-842c-041b6b27eae6 with Priority: HIGHEST for action port [ 604.970704] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec29d907-7e62-4499-842c-041b6b27eae6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.970830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec29d907-7e62-4499-842c-041b6b27eae6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.970901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec29d907-7e62-4499-842c-041b6b27eae6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.971199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec29d907-7e62-4499-842c-041b6b27eae6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.971278] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec29d907-7e62-4499-842c-041b6b27eae6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.998685] env[67003]: INFO networking_nsxv3.common.synchronization [req-976ce1c4-71a4-40da-b5f8-e294f6a125f7 req-6598a0b1-2a7d-4564-a22c-81022f34589b service nova] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_rules [ 604.998905] env[67003]: INFO networking_nsxv3.common.synchronization [req-976ce1c4-71a4-40da-b5f8-e294f6a125f7 req-6598a0b1-2a7d-4564-a22c-81022f34589b service nova] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 604.999273] env[67003]: INFO networking_nsxv3.common.synchronization [req-976ce1c4-71a4-40da-b5f8-e294f6a125f7 req-6598a0b1-2a7d-4564-a22c-81022f34589b service nova] Enqueued Resource ID: 9eb880c1-0152-4ec0-aca1-327a0acac117 with Priority: HIGHEST for action port [ 604.999907] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_rules [ 605.000026] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 605.000644] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eb880c1-0152-4ec0-aca1-327a0acac117 with Priority: HIGHEST for action port [ 605.001571] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.001696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.001767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.002035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.002124] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.003110] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.003563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.003919] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.004150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.004324] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.004945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.005258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.005510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.005636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.006270] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.007283] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-9eb880c1-0152-4ec0-aca1-327a0acac117 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.007406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9eb880c1-0152-4ec0-aca1-327a0acac117" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.007477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9eb880c1-0152-4ec0-aca1-327a0acac117" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.007656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9eb880c1-0152-4ec0-aca1-327a0acac117" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.007744] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9eb880c1-0152-4ec0-aca1-327a0acac117',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.040491] env[67003]: INFO networking_nsxv3.common.synchronization [None req-c6033715-2f84-4af4-8988-7608109b70b9 tempest-VolumesAssistedSnapshotsTest-908302373 tempest-VolumesAssistedSnapshotsTest-908302373-project-member] Enqueued Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGHEST for action security_group_rules [ 605.040491] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGHEST for action security_group_rules [ 605.040491] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.040491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.040491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.041075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.041075] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a279ae9a-5f5b-4b3f-a403-fcef8683474d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.049234] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.049234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.049234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.049234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.049234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.063387] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: IN_PROGRESS for 2s [ 605.198841] env[67003]: INFO networking_nsxv3.common.synchronization [None req-3c8a5370-00be-4dcf-a715-63b8f26cf5d6 tempest-VolumesAssistedSnapshotsTest-908302373 tempest-VolumesAssistedSnapshotsTest-908302373-project-member] Enqueued Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGHEST for action security_group_rules [ 605.199740] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGHEST for action security_group_rules [ 605.200189] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.200189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.477486] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec29d907-7e62-4499-842c-041b6b27eae6 [ 605.477486] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.477486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.477486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.477486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.477486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.477486] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec29d907-7e62-4499-842c-041b6b27eae6 already deleted. [ 605.477486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec29d907-7e62-4499-842c-041b6b27eae6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.513181] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.513181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.513181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.513181] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9eb880c1-0152-4ec0-aca1-327a0acac117 with status ACTIVE [ 605.513181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.513181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.513181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.513181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.513181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.513181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.513181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.513181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.513181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.513181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.513864] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.513864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.514110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.514377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.516296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.516296] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9eb880c1-0152-4ec0-aca1-327a0acac117 is going to be updated. [ 605.536090] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.536981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.536981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.536981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.538803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.538803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9eb880c1-0152-4ec0-aca1-327a0acac117" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.565283] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.565421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.565494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.569104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.569104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.569104] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d already deleted. [ 605.569104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.569104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.569104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.569104] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a279ae9a-5f5b-4b3f-a403-fcef8683474d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.847107] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 in Status: SUCCESS [ 605.847379] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.016692] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.091595] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.091595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.091595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.091763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.092498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.092498] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d already deleted. [ 606.092498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.238096] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 in Status: SUCCESS [ 606.239513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.239730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.240024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.241289] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.241487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.241582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.241812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.243867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.243962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.244067] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8df0b4b9-9305-44fa-8ffb-138abad7c0b5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.519583] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.519884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.519969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.520304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.520410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.520542] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be created. [ 606.548935] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.549448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.549448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.549643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.549899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.561698] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: UNINITIALIZED for 2s [ 606.747551] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.747725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.747788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.747984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.748167] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.748269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.748335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.748486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.748572] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.748655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.748798] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.748890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.748951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.749108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.749245] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.749335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.749390] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.749637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.749855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.749948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.751179] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8df0b4b9-9305-44fa-8ffb-138abad7c0b5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.789160] env[67003]: INFO networking_nsxv3.common.synchronization [None req-2898daba-dbf8-4f02-8141-8180050dee95 None None] Enqueued Resource ID: 4d3b4cb5-a21f-434a-bed5-ffbc34880ba4 with Priority: HIGHEST for action port [ 606.793047] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d3b4cb5-a21f-434a-bed5-ffbc34880ba4 with Priority: HIGHEST for action port [ 606.793047] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d3b4cb5-a21f-434a-bed5-ffbc34880ba4 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.793047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d3b4cb5-a21f-434a-bed5-ffbc34880ba4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.793047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d3b4cb5-a21f-434a-bed5-ffbc34880ba4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.793047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d3b4cb5-a21f-434a-bed5-ffbc34880ba4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.793047] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d3b4cb5-a21f-434a-bed5-ffbc34880ba4',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.077706] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: SUCCESS [ 607.077706] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.254102] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8df0b4b9-9305-44fa-8ffb-138abad7c0b5: rpc.has_security_group_logging(os_id): False [ 607.272416] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.272547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.272614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.272858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.272950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.273311] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.273311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.273474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.273474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.273570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.273750] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.273843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.273907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.274062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.274141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.274313] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.276568] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.276663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.276795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.276910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.276961] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 is going to be created. [ 607.297249] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4d3b4cb5-a21f-434a-bed5-ffbc34880ba4 [ 607.300472] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.300472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.300472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.300472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.300472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.300472] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4d3b4cb5-a21f-434a-bed5-ffbc34880ba4 already deleted. [ 607.300472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d3b4cb5-a21f-434a-bed5-ffbc34880ba4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.347286] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.347413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.347482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.347689] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.347918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.359920] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 in Status: IN_PROGRESS for 2s [ 607.886179] env[67003]: INFO networking_nsxv3.common.synchronization [req-2291ad66-f17b-4853-b572-c087a35c0356 req-62793107-a7b8-41e5-83e8-e5b6b5818f91 tempest-ServersTestMultiNic-1026664683 tempest-ServersTestMultiNic-1026664683-project-member] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 607.886179] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 607.886887] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.886887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.886887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.886887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.886887] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.887243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.887243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.888245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.888359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.888440] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.236483] env[67003]: INFO networking_nsxv3.common.synchronization [None req-de0b91cb-5771-45fa-a37b-5d6afae1de50 None None] Enqueued Resource ID: 7a802dc8-1463-48d3-ba90-c96c827bcdfe with Priority: HIGHEST for action port [ 608.236483] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a802dc8-1463-48d3-ba90-c96c827bcdfe with Priority: HIGHEST for action port [ 608.237806] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-7a802dc8-1463-48d3-ba90-c96c827bcdfe taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.238126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7a802dc8-1463-48d3-ba90-c96c827bcdfe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.238126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7a802dc8-1463-48d3-ba90-c96c827bcdfe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.238208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7a802dc8-1463-48d3-ba90-c96c827bcdfe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.238292] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7a802dc8-1463-48d3-ba90-c96c827bcdfe',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.391113] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.391632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.391632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.391632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.391632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.392278] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.392278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.392278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.392278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.392278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.392476] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 already deleted. [ 608.392476] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.475027] env[67003]: INFO networking_nsxv3.common.synchronization [req-2291ad66-f17b-4853-b572-c087a35c0356 req-236d0679-cb48-405a-9848-d9d68bbc91c8 tempest-ServersTestMultiNic-1026664683 tempest-ServersTestMultiNic-1026664683-project-member] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 608.475579] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 608.475886] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.476025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.476110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.476279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.476561] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.476561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.476744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.476744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.476878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.476996] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.572901] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: SUCCESS [ 608.573922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.573922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.573922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.573922] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.573922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.574227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.574227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.574227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.574376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.574410] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.741219] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7a802dc8-1463-48d3-ba90-c96c827bcdfe [ 608.741476] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.742124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.742124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.742124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.742124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.742124] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7a802dc8-1463-48d3-ba90-c96c827bcdfe already deleted. [ 608.742124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7a802dc8-1463-48d3-ba90-c96c827bcdfe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.980246] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.980246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.980246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.980246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.980246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.980908] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.980908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.980908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.980908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.980908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.980908] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 already deleted. [ 608.981095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.984883] env[67003]: INFO networking_nsxv3.common.synchronization [req-2291ad66-f17b-4853-b572-c087a35c0356 req-f008ad0c-80c1-4de2-b4be-26f6cada1938 tempest-ServersTestMultiNic-1026664683 tempest-ServersTestMultiNic-1026664683-project-member] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 608.984883] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 608.985192] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.985301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.985367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.985532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.985680] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.985775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.985835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.985976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.986147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.986242] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.008514] env[67003]: INFO networking_nsxv3.common.synchronization [None req-bbb4162b-9ebe-4e5c-8b2d-324e7a517e77 None None] Enqueued Resource ID: e0fff499-aaae-47f8-bb61-438e1d06a71d with Priority: HIGHEST for action port [ 609.008763] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0fff499-aaae-47f8-bb61-438e1d06a71d with Priority: HIGHEST for action port [ 609.009324] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0fff499-aaae-47f8-bb61-438e1d06a71d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.009448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0fff499-aaae-47f8-bb61-438e1d06a71d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.009512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0fff499-aaae-47f8-bb61-438e1d06a71d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.009763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0fff499-aaae-47f8-bb61-438e1d06a71d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.010264] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0fff499-aaae-47f8-bb61-438e1d06a71d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.077888] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.078062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.078142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.078367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.078617] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.078745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.078816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.078972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.079069] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.079159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.079310] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.079402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.079463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.080291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.080291] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.080291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.080291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.080291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.080291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.080291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.080291] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.377182] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 in Status: SUCCESS [ 609.377412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.408448] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.408665] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-806" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.408933] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-806" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.409364] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-806" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.409687] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.409826] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.409957] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.410231] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.410375] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.410629] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.410754] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.410947] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.411020] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.411144] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.411250] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.411382] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.432999] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.432999] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.432999] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.433267] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-806" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.433390] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-3fcbf3c6-f938-4509-9a61-c0a7b5fd574b taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.434105] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-3fcbf3c6-f938-4509-9a61-c0a7b5fd574b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.434105] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-3fcbf3c6-f938-4509-9a61-c0a7b5fd574b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.434434] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-3fcbf3c6-f938-4509-9a61-c0a7b5fd574b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.434581] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fcbf3c6-f938-4509-9a61-c0a7b5fd574b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.489585] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.489827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.489827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.490093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.490184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.490385] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.490492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.490574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.490693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.490790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.490851] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 already deleted. [ 609.490915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.511647] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0fff499-aaae-47f8-bb61-438e1d06a71d [ 609.511886] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.513493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.513493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.513493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.513493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.513493] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0fff499-aaae-47f8-bb61-438e1d06a71d already deleted. [ 609.513493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0fff499-aaae-47f8-bb61-438e1d06a71d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.583404] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94cc9917-b413-4c1b-9c52-44b1bbb1141a: rpc.has_security_group_logging(os_id): False [ 609.602909] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.603123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.603173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.603433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.603514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.603723] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.603867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.603973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.604131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.604199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.604546] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.604546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.604546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.604799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.604893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.605095] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.605188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.605520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.605692] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.605766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.605854] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be created. [ 609.670204] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.671066] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.671066] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.671066] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.671066] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.683030] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: IN_PROGRESS for 2s [ 609.941155] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.941155] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.941155] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.941155] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.941155] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.941155] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 3fcbf3c6-f938-4509-9a61-c0a7b5fd574b not found, creating... [ 609.941155] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.941155] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.941155] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.941155] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.941155] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.941704] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.941704] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.941952] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.942313] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.942621] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.944172] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 3fcbf3c6-f938-4509-9a61-c0a7b5fd574b is going to be created. [ 609.966606] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.966606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.966606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.966606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.966606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.966606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-3fcbf3c6-f938-4509-9a61-c0a7b5fd574b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.080027] env[67003]: INFO networking_nsxv3.common.synchronization [None req-c967e565-33c7-48ff-ae53-83e5b3e37e35 None None] Enqueued Resource ID: 14f55b1a-2a0e-44dc-b1cc-06a3b1757bc7 with Priority: HIGHEST for action port [ 610.080027] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14f55b1a-2a0e-44dc-b1cc-06a3b1757bc7 with Priority: HIGHEST for action port [ 610.080027] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-14f55b1a-2a0e-44dc-b1cc-06a3b1757bc7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.080027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14f55b1a-2a0e-44dc-b1cc-06a3b1757bc7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.080027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14f55b1a-2a0e-44dc-b1cc-06a3b1757bc7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.080027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14f55b1a-2a0e-44dc-b1cc-06a3b1757bc7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.081956] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14f55b1a-2a0e-44dc-b1cc-06a3b1757bc7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.571902] env[67003]: INFO networking_nsxv3.common.synchronization [req-47da0553-fdd0-4860-a712-0d92b8e92863 req-831c1c47-29fe-4a0e-a31d-1053026b535d tempest-VolumesAdminNegativeTest-1833608575 tempest-VolumesAdminNegativeTest-1833608575-project-member] Enqueued Resource ID: 187f2eae-7657-4240-8ccd-728badf3526c with Priority: HIGHEST for action security_group_members [ 610.573818] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f2eae-7657-4240-8ccd-728badf3526c with Priority: HIGHEST for action security_group_members [ 610.574517] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f2eae-7657-4240-8ccd-728badf3526c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.574983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.574983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.575322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.576055] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.576055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.576055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.576055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.576055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.576055] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f2eae-7657-4240-8ccd-728badf3526c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.584265] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14f55b1a-2a0e-44dc-b1cc-06a3b1757bc7 [ 610.584429] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.584570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.584759] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.584820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.585182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.585182] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14f55b1a-2a0e-44dc-b1cc-06a3b1757bc7 already deleted. [ 610.585182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14f55b1a-2a0e-44dc-b1cc-06a3b1757bc7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.723287] env[67003]: INFO networking_nsxv3.common.synchronization [req-2291ad66-f17b-4853-b572-c087a35c0356 req-da4ebf6e-b1c2-4e50-99f9-1fca02c769b7 service nova] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_rules [ 610.723287] env[67003]: INFO networking_nsxv3.common.synchronization [req-2291ad66-f17b-4853-b572-c087a35c0356 req-da4ebf6e-b1c2-4e50-99f9-1fca02c769b7 service nova] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 610.723287] env[67003]: INFO networking_nsxv3.common.synchronization [req-2291ad66-f17b-4853-b572-c087a35c0356 req-da4ebf6e-b1c2-4e50-99f9-1fca02c769b7 service nova] Enqueued Resource ID: 3fcbf3c6-f938-4509-9a61-c0a7b5fd574b with Priority: HIGHEST for action port [ 610.723675] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_rules [ 610.723828] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 610.723964] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3fcbf3c6-f938-4509-9a61-c0a7b5fd574b with Priority: HIGHEST for action port [ 610.726631] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.726818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.726867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.727105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.727190] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.728089] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.728211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.728279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.728455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.728600] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.728694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.728758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.728895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.728983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.729085] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.730758] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-3fcbf3c6-f938-4509-9a61-c0a7b5fd574b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.731448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3fcbf3c6-f938-4509-9a61-c0a7b5fd574b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.731448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3fcbf3c6-f938-4509-9a61-c0a7b5fd574b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.731448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3fcbf3c6-f938-4509-9a61-c0a7b5fd574b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.731448] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3fcbf3c6-f938-4509-9a61-c0a7b5fd574b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.916957] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ab2f0a33-d44e-4421-a2f7-32c6eb9be0b7 None None] Enqueued Resource ID: 5f202176-752f-4a9b-bf41-21ba20392459 with Priority: HIGHEST for action port [ 610.917568] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f202176-752f-4a9b-bf41-21ba20392459 with Priority: HIGHEST for action port [ 610.917807] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f202176-752f-4a9b-bf41-21ba20392459 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.917933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f202176-752f-4a9b-bf41-21ba20392459" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.918013] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f202176-752f-4a9b-bf41-21ba20392459" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.919552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f202176-752f-4a9b-bf41-21ba20392459" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.919829] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f202176-752f-4a9b-bf41-21ba20392459',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.079421] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.079421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.079421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.079606] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.079712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.079945] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.080152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.080152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.080559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.080559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.080559] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f2eae-7657-4240-8ccd-728badf3526c already deleted. [ 611.080559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.082630] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.082869] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.083016] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.108697] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.109071] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.109264] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.109418] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.109656] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.109799] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.110015] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.110133] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.110319] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.110368] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.111262] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.111262] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.111262] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.136429] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.136584] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.136621] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.136777] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.137104] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-db057b19-2d23-4933-8ee1-d2f38d6a3493 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.137324] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-db057b19-2d23-4933-8ee1-d2f38d6a3493" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.137468] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-db057b19-2d23-4933-8ee1-d2f38d6a3493" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.137778] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-db057b19-2d23-4933-8ee1-d2f38d6a3493" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.137981] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db057b19-2d23-4933-8ee1-d2f38d6a3493',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.233632] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3fcbf3c6-f938-4509-9a61-c0a7b5fd574b with status ACTIVE [ 611.233632] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.233632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.233632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.233632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.233632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.233934] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.233934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.234039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.235070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.235070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.235070] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.235070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.235070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.235070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.235070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.235070] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3fcbf3c6-f938-4509-9a61-c0a7b5fd574b is going to be updated. [ 611.235956] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.237881] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.237881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.258618] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.258770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.258811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.259043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.259186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.260171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3fcbf3c6-f938-4509-9a61-c0a7b5fd574b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.421408] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f202176-752f-4a9b-bf41-21ba20392459 [ 611.421729] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.421895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.421990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.422675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.422675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.422675] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f202176-752f-4a9b-bf41-21ba20392459 already deleted. [ 611.422675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f202176-752f-4a9b-bf41-21ba20392459" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.640321] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.641085] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.641085] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.641085] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.641230] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.641405] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port db057b19-2d23-4933-8ee1-d2f38d6a3493 not found, creating... [ 611.641718] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.641880] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.642012] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.642255] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.642400] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.643343] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.643655] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.643895] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.644069] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.644223] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.644353] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: db057b19-2d23-4933-8ee1-d2f38d6a3493 is going to be created. [ 611.675682] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.675910] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.675910] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.676194] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.676418] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.676572] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-db057b19-2d23-4933-8ee1-d2f38d6a3493" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.704643] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: SUCCESS [ 611.704895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.741542] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.871656] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-3 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.871910] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.871986] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.872388] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.873335] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.873549] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.873776] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.874183] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.874364] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.874613] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.874741] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 611.874853] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 611.875080] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 611.875191] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 611.875313] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 611.875453] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 611.898160] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 611.898389] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 611.898548] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 611.898768] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.899545] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-07921951-b91b-459f-a9db-d0b91d3cb427 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.899545] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-07921951-b91b-459f-a9db-d0b91d3cb427" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.899545] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-07921951-b91b-459f-a9db-d0b91d3cb427" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.899876] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-07921951-b91b-459f-a9db-d0b91d3cb427" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.900028] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07921951-b91b-459f-a9db-d0b91d3cb427',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.244284] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.244513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.244513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.245108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.245108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.245108] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be created. [ 612.277880] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.278149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.278149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.278326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.278530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.296993] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: UNINITIALIZED for 2s [ 612.374699] env[67003]: INFO networking_nsxv3.common.synchronization [req-47da0553-fdd0-4860-a712-0d92b8e92863 req-eecf3cbe-18d2-4f5d-bab6-0dee90d9ef0f service nova] Enqueued Resource ID: 187f2eae-7657-4240-8ccd-728badf3526c with Priority: HIGHEST for action security_group_rules [ 612.375362] env[67003]: INFO networking_nsxv3.common.synchronization [req-47da0553-fdd0-4860-a712-0d92b8e92863 req-eecf3cbe-18d2-4f5d-bab6-0dee90d9ef0f service nova] Enqueued Resource ID: 187f2eae-7657-4240-8ccd-728badf3526c with Priority: HIGHEST for action security_group_members [ 612.375670] env[67003]: INFO networking_nsxv3.common.synchronization [req-47da0553-fdd0-4860-a712-0d92b8e92863 req-eecf3cbe-18d2-4f5d-bab6-0dee90d9ef0f service nova] Enqueued Resource ID: db057b19-2d23-4933-8ee1-d2f38d6a3493 with Priority: HIGHEST for action port [ 612.377038] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f2eae-7657-4240-8ccd-728badf3526c with Priority: HIGHEST for action security_group_rules [ 612.377989] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f2eae-7657-4240-8ccd-728badf3526c with Priority: HIGHEST for action security_group_members [ 612.377989] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db057b19-2d23-4933-8ee1-d2f38d6a3493 with Priority: HIGHEST for action port [ 612.378478] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-187f2eae-7657-4240-8ccd-728badf3526c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.379160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.379446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.380067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.380311] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('187f2eae-7657-4240-8ccd-728badf3526c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.383730] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f2eae-7657-4240-8ccd-728badf3526c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.383988] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.384252] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.384782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.385172] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.385417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.385509] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.385732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.385964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.386144] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f2eae-7657-4240-8ccd-728badf3526c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.388627] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-db057b19-2d23-4933-8ee1-d2f38d6a3493 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.388805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db057b19-2d23-4933-8ee1-d2f38d6a3493" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.388805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db057b19-2d23-4933-8ee1-d2f38d6a3493" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.389039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db057b19-2d23-4933-8ee1-d2f38d6a3493" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.389161] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db057b19-2d23-4933-8ee1-d2f38d6a3493',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.404018] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.404313] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.404445] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.404728] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.404889] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.405152] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 07921951-b91b-459f-a9db-d0b91d3cb427 not found, creating... [ 612.405899] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.405899] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.405899] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.406395] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.406395] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.406592] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.406792] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.407032] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.407259] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.407492] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.407613] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 07921951-b91b-459f-a9db-d0b91d3cb427 is going to be created. [ 612.432554] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.432887] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.433064] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.433448] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.433801] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.434130] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-07921951-b91b-459f-a9db-d0b91d3cb427" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.792785] env[67003]: INFO networking_nsxv3.common.synchronization [None req-324851ad-b562-4ffb-8fbb-afe1130ca966 tempest-ServersTestFqdnHostnames-1925503962 tempest-ServersTestFqdnHostnames-1925503962-project-member] Enqueued Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGHEST for action security_group_rules [ 612.793496] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGHEST for action security_group_rules [ 612.793860] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.794054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.794165] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.794482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.794584] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64b82baf-96b3-4d2a-a0f3-634fd5e24137',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.884538] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f2eae-7657-4240-8ccd-728badf3526c taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.884666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.889492] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('187f2eae-7657-4240-8ccd-728badf3526c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.891878] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db057b19-2d23-4933-8ee1-d2f38d6a3493 with status ACTIVE [ 612.892138] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.892316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.892378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.894172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.894172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.894172] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.894172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.894172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.894172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.894172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.894172] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.894172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.896982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.896982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.896982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.896982] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db057b19-2d23-4933-8ee1-d2f38d6a3493 is going to be updated. [ 612.921537] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.921706] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.921763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.921977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.922139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.923033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db057b19-2d23-4933-8ee1-d2f38d6a3493" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.175681] env[67003]: INFO networking_nsxv3.common.synchronization [None req-187d1ef8-5179-4b95-a40b-ff420fc851fb None None] Enqueued Resource ID: b0c96ef2-660a-4b0b-b99b-900509924e0d with Priority: HIGHEST for action port [ 613.176213] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0c96ef2-660a-4b0b-b99b-900509924e0d with Priority: HIGHEST for action port [ 613.176515] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0c96ef2-660a-4b0b-b99b-900509924e0d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.176713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0c96ef2-660a-4b0b-b99b-900509924e0d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.176713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0c96ef2-660a-4b0b-b99b-900509924e0d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.176984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0c96ef2-660a-4b0b-b99b-900509924e0d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.177615] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0c96ef2-660a-4b0b-b99b-900509924e0d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.204825] env[67003]: INFO networking_nsxv3.common.synchronization [req-2291ad66-f17b-4853-b572-c087a35c0356 req-1761cd8d-ae8b-48d5-a1b4-2d594aab40ae service nova] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_rules [ 613.205212] env[67003]: INFO networking_nsxv3.common.synchronization [req-2291ad66-f17b-4853-b572-c087a35c0356 req-1761cd8d-ae8b-48d5-a1b4-2d594aab40ae service nova] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 613.205212] env[67003]: INFO networking_nsxv3.common.synchronization [req-2291ad66-f17b-4853-b572-c087a35c0356 req-1761cd8d-ae8b-48d5-a1b4-2d594aab40ae service nova] Enqueued Resource ID: 07921951-b91b-459f-a9db-d0b91d3cb427 with Priority: HIGHEST for action port [ 613.205631] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_rules [ 613.205631] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 613.205631] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07921951-b91b-459f-a9db-d0b91d3cb427 with Priority: HIGHEST for action port [ 613.206254] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.206340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.206545] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.206670] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.206859] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-07921951-b91b-459f-a9db-d0b91d3cb427 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.207067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07921951-b91b-459f-a9db-d0b91d3cb427" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.207067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07921951-b91b-459f-a9db-d0b91d3cb427" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.207345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07921951-b91b-459f-a9db-d0b91d3cb427" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.207345] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07921951-b91b-459f-a9db-d0b91d3cb427',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.321850] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.321850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.321850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.321850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.322159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.322159] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 already deleted. [ 613.322159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.392870] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('187f2eae-7657-4240-8ccd-728badf3526c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.664419] env[67003]: INFO networking_nsxv3.common.synchronization [req-75eeed92-3b8b-4ed6-afd3-dd597635ee36 req-531645ef-8dad-40fa-a1ad-fad8889d4366 tempest-ServerDiagnosticsNegativeTest-419304698 tempest-ServerDiagnosticsNegativeTest-419304698-project-member] Enqueued Resource ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b with Priority: HIGHEST for action security_group_members [ 613.664419] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b with Priority: HIGHEST for action security_group_members [ 613.664419] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4a2c13a-9225-49c6-996f-0d53b89aa94b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.664419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.664419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.664419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.665021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.668549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.668549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.668549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.668549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.668549] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4a2c13a-9225-49c6-996f-0d53b89aa94b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.669752] env[67003]: INFO networking_nsxv3.common.synchronization [None req-a7239de3-886d-4e27-ade6-6138d910b09d tempest-ServersTestFqdnHostnames-1925503962 tempest-ServersTestFqdnHostnames-1925503962-project-member] Enqueued Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGHEST for action security_group_rules [ 613.670570] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGHEST for action security_group_rules [ 613.671045] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.671392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.671590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.671882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.672088] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64b82baf-96b3-4d2a-a0f3-634fd5e24137',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.681141] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b0c96ef2-660a-4b0b-b99b-900509924e0d [ 613.681568] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.682185] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.683218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.683218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.683218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.683218] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b0c96ef2-660a-4b0b-b99b-900509924e0d already deleted. [ 613.683218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0c96ef2-660a-4b0b-b99b-900509924e0d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.709481] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07921951-b91b-459f-a9db-d0b91d3cb427 with status ACTIVE [ 613.709707] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.709846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.711049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.711049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.711049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.711049] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.711049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.711049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.711049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.711049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.711049] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.711049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.711453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.711453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.711453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.711453] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07921951-b91b-459f-a9db-d0b91d3cb427 is going to be updated. [ 613.732325] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.732457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.732516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.732753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.732938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.733142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07921951-b91b-459f-a9db-d0b91d3cb427" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.896041] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.896360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.896360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.896490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.896552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.896812] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f2eae-7657-4240-8ccd-728badf3526c is going to be created. [ 613.922968] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.923171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.923234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.923441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.923595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.935367] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f2eae-7657-4240-8ccd-728badf3526c in Status: UNINITIALIZED for 2s [ 614.172095] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.172262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.172335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.172559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.172656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.172882] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.172983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.173060] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.174127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.174354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.174479] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b already deleted. [ 614.174604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.195407] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.195725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.195879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.196303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.196492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.196678] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 already deleted. [ 614.196822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.308774] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 614.309062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.309259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.309634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.309874] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.310030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.310101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.310313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.310404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.310487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.310618] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.311930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.312121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.312287] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.312393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.312457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.312598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.312675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.312817] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.516210] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.516474] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.516679] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.517015] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.517344] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.517565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.517743] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.518103] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.518319] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.518601] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.518766] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.518921] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.519120] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.519264] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.519390] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.519541] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.539298] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.539298] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.539298] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.539298] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.539599] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-8128211a-c65c-4300-95bb-398f42148d48 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.539673] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-8128211a-c65c-4300-95bb-398f42148d48" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.541918] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-8128211a-c65c-4300-95bb-398f42148d48" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.541918] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-8128211a-c65c-4300-95bb-398f42148d48" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.541918] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8128211a-c65c-4300-95bb-398f42148d48',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.629259] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-806 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.629938] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-806" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.629938] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-806" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.629938] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-806" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.630110] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.630243] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.630355] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.630563] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.630951] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.631171] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.631355] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 614.631471] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 614.631657] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 614.631770] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 614.631944] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 614.632100] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 614.651687] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 614.651882] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 614.652026] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 614.652248] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-806" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.652579] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-bb9260ba-9fed-464c-b121-83bf60020c08 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.652792] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-bb9260ba-9fed-464c-b121-83bf60020c08" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.652948] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-bb9260ba-9fed-464c-b121-83bf60020c08" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.653278] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-bb9260ba-9fed-464c-b121-83bf60020c08" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.653456] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb9260ba-9fed-464c-b121-83bf60020c08',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.816520] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.816665] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.816859] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.043457] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.043457] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.043937] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.043937] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.044023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.044130] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 8128211a-c65c-4300-95bb-398f42148d48 not found, creating... [ 615.044388] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.044543] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.044655] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.044912] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.045067] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.045302] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.045454] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.045569] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.045797] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.045910] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.046058] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 8128211a-c65c-4300-95bb-398f42148d48 is going to be created. [ 615.080409] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.080915] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.081104] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.081424] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.081674] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.081909] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-8128211a-c65c-4300-95bb-398f42148d48" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.156277] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.156522] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.156656] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.156957] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.157134] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.157314] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port bb9260ba-9fed-464c-b121-83bf60020c08 not found, creating... [ 615.157593] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.157756] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.157881] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.158117] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.158262] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.158681] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.158912] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.159016] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.159256] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.159389] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.159527] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: bb9260ba-9fed-464c-b121-83bf60020c08 is going to be created. [ 615.180996] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.181289] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.181426] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.181726] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.182019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.182259] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-bb9260ba-9fed-464c-b121-83bf60020c08" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.318930] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.823063] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.823063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.823063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.823268] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.823305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.823400] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 615.828660] env[67003]: INFO networking_nsxv3.common.synchronization [req-75eeed92-3b8b-4ed6-afd3-dd597635ee36 req-e5107342-c678-4f90-a953-4bea99b9ee62 service nova] Enqueued Resource ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b with Priority: HIGHEST for action security_group_rules [ 615.828660] env[67003]: INFO networking_nsxv3.common.synchronization [req-75eeed92-3b8b-4ed6-afd3-dd597635ee36 req-e5107342-c678-4f90-a953-4bea99b9ee62 service nova] Enqueued Resource ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b with Priority: HIGHEST for action security_group_members [ 615.828660] env[67003]: INFO networking_nsxv3.common.synchronization [req-75eeed92-3b8b-4ed6-afd3-dd597635ee36 req-e5107342-c678-4f90-a953-4bea99b9ee62 service nova] Enqueued Resource ID: 8128211a-c65c-4300-95bb-398f42148d48 with Priority: HIGHEST for action port [ 615.829248] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b with Priority: HIGHEST for action security_group_rules [ 615.829362] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b with Priority: HIGHEST for action security_group_members [ 615.829488] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8128211a-c65c-4300-95bb-398f42148d48 with Priority: HIGHEST for action port [ 615.830104] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4a2c13a-9225-49c6-996f-0d53b89aa94b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.830236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.830236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.830468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.830558] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4a2c13a-9225-49c6-996f-0d53b89aa94b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.831931] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4a2c13a-9225-49c6-996f-0d53b89aa94b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.831931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.831931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.831931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.832097] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.832097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.832169] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.832416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.832494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.832541] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4a2c13a-9225-49c6-996f-0d53b89aa94b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.835432] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-8128211a-c65c-4300-95bb-398f42148d48 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.835559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8128211a-c65c-4300-95bb-398f42148d48" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.835559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8128211a-c65c-4300-95bb-398f42148d48" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.835845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8128211a-c65c-4300-95bb-398f42148d48" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.835845] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8128211a-c65c-4300-95bb-398f42148d48',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.874483] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.874580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.874617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.875595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.875595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.885775] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 615.946039] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f2eae-7657-4240-8ccd-728badf3526c in Status: SUCCESS [ 615.946039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.946236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.946424] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.946617] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.946741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.947553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.947553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.947553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.947553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.947553] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('187f2eae-7657-4240-8ccd-728badf3526c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.960028] env[67003]: INFO networking_nsxv3.common.synchronization [req-2291ad66-f17b-4853-b572-c087a35c0356 req-8de927cf-d7e0-44d4-aa75-68280663110c service nova] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_rules [ 615.960028] env[67003]: INFO networking_nsxv3.common.synchronization [req-2291ad66-f17b-4853-b572-c087a35c0356 req-8de927cf-d7e0-44d4-aa75-68280663110c service nova] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 615.960028] env[67003]: INFO networking_nsxv3.common.synchronization [req-2291ad66-f17b-4853-b572-c087a35c0356 req-8de927cf-d7e0-44d4-aa75-68280663110c service nova] Enqueued Resource ID: bb9260ba-9fed-464c-b121-83bf60020c08 with Priority: HIGHEST for action port [ 615.960028] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_rules [ 615.960028] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 615.960028] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb9260ba-9fed-464c-b121-83bf60020c08 with Priority: HIGHEST for action port [ 615.960304] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.960397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.960839] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.960839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.961448] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb9260ba-9fed-464c-b121-83bf60020c08 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.961448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb9260ba-9fed-464c-b121-83bf60020c08" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.961448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb9260ba-9fed-464c-b121-83bf60020c08" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.961690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb9260ba-9fed-464c-b121-83bf60020c08" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.961722] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb9260ba-9fed-464c-b121-83bf60020c08',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.337769] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4a2c13a-9225-49c6-996f-0d53b89aa94b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.338814] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4a2c13a-9225-49c6-996f-0d53b89aa94b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.338934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.339679] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8128211a-c65c-4300-95bb-398f42148d48 with status ACTIVE [ 616.339679] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.339679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.339679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.340048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.340048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.340048] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.340166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.340202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.340353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.340429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.340601] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.340735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.340805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.341039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.341039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.344371] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8128211a-c65c-4300-95bb-398f42148d48 is going to be updated. [ 616.368199] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.368330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.368374] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.369186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.369186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.369186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8128211a-c65c-4300-95bb-398f42148d48" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.450817] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f2eae-7657-4240-8ccd-728badf3526c taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.450982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.451084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.451312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.451489] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.451589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.451657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.451808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.452038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.452038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.452145] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f2eae-7657-4240-8ccd-728badf3526c taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.452238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.452299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.452439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.452590] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.452664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.452773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.452915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.453014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.453100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.453193] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('187f2eae-7657-4240-8ccd-728badf3526c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.466637] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb9260ba-9fed-464c-b121-83bf60020c08 with status ACTIVE [ 616.466859] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.467000] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.467080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.467291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.467377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.467553] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.467655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.467720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.467899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.467935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.468137] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.468316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.468392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.468619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.469165] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.469165] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb9260ba-9fed-464c-b121-83bf60020c08 is going to be updated. [ 616.490776] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.490968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.491024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.491224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.491367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.491524] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb9260ba-9fed-464c-b121-83bf60020c08" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.552722] env[67003]: INFO networking_nsxv3.common.synchronization [req-518c514e-6287-44f2-9f23-995e11879d28 req-7c7b5ad8-5e42-4a5a-8c44-9602c06a7c75 tempest-ServerExternalEventsTest-588363590 tempest-ServerExternalEventsTest-588363590-project-member] Enqueued Resource ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 with Priority: HIGHEST for action security_group_members [ 616.553044] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 with Priority: HIGHEST for action security_group_members [ 616.553444] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.553542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.553542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.553800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.555979] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.555979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.556152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.556349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.556349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.556863] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea05aafd-d89a-4a4a-8f6a-25194a42d3e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.840068] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4a2c13a-9225-49c6-996f-0d53b89aa94b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.956434] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 187f2eae-7657-4240-8ccd-728badf3526c: rpc.has_security_group_logging(os_id): False [ 616.977190] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.977190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.977190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.977190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.977190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.977919] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.978097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.979435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.979435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.979435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.979435] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.979435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.979435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.979435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.979435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.979435] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.979877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.979877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.980129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.980827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.980827] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 187f2eae-7657-4240-8ccd-728badf3526c is going to be created. [ 617.039527] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.039701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.039784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.040028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.040223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.052073] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.052270] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.052390] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.052654] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.052960] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.053138] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.053251] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.053524] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.053614] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.053903] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.054017] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.054089] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.054192] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.054299] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.054396] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.054519] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.056107] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187f2eae-7657-4240-8ccd-728badf3526c in Status: IN_PROGRESS for 2s [ 617.059486] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.059617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.059695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.059869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.059959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.060160] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.060262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.060326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.060467] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.060543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.060689] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 already deleted. [ 617.060761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.076864] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.077056] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.077229] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.077404] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.077710] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-068a0402-e7b3-4980-ad42-b4971dad6aa4 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.077878] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-068a0402-e7b3-4980-ad42-b4971dad6aa4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.077994] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-068a0402-e7b3-4980-ad42-b4971dad6aa4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.078366] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-068a0402-e7b3-4980-ad42-b4971dad6aa4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.078499] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('068a0402-e7b3-4980-ad42-b4971dad6aa4',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.342985] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.343466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.343466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.343466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.343632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.343632] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b is going to be created. [ 617.384187] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.384627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.384627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.384740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.384995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.402150] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b in Status: UNINITIALIZED for 2s [ 617.580985] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.581287] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.581414] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.581692] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.581839] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.581987] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 068a0402-e7b3-4980-ad42-b4971dad6aa4 not found, creating... [ 617.582263] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.582420] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.582552] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.582820] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.582970] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.583285] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.583449] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.583571] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.583801] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.583948] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.584121] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 068a0402-e7b3-4980-ad42-b4971dad6aa4 is going to be created. [ 617.606281] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.606525] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.606653] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.606975] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.607227] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.607452] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-068a0402-e7b3-4980-ad42-b4971dad6aa4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.896727] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 617.896959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.897190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.897451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.897653] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.897785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.897846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.898013] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.898101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.898187] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.898600] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.898600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.898600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.898825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.898825] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.898915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.898915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.899062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.899155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.899233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.899334] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.900171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.900367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.900508] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.900608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.900702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.900884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.901029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.901190] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.303127] env[67003]: INFO networking_nsxv3.common.synchronization [req-518c514e-6287-44f2-9f23-995e11879d28 req-d334873a-2512-462b-874c-daaaef46d4d6 service nova] Enqueued Resource ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 with Priority: HIGHEST for action security_group_rules [ 618.303470] env[67003]: INFO networking_nsxv3.common.synchronization [req-518c514e-6287-44f2-9f23-995e11879d28 req-d334873a-2512-462b-874c-daaaef46d4d6 service nova] Enqueued Resource ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 with Priority: HIGHEST for action security_group_members [ 618.303635] env[67003]: INFO networking_nsxv3.common.synchronization [req-518c514e-6287-44f2-9f23-995e11879d28 req-d334873a-2512-462b-874c-daaaef46d4d6 service nova] Enqueued Resource ID: 068a0402-e7b3-4980-ad42-b4971dad6aa4 with Priority: HIGHEST for action port [ 618.304953] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 with Priority: HIGHEST for action security_group_rules [ 618.305161] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 with Priority: HIGHEST for action security_group_members [ 618.306055] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 068a0402-e7b3-4980-ad42-b4971dad6aa4 with Priority: HIGHEST for action port [ 618.306055] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.306055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.306055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.306616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.306616] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea05aafd-d89a-4a4a-8f6a-25194a42d3e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.309635] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.309635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.309635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.310234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.310970] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.311180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.311319] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.311603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.311681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.311786] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea05aafd-d89a-4a4a-8f6a-25194a42d3e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.312768] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-068a0402-e7b3-4980-ad42-b4971dad6aa4 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.312968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-068a0402-e7b3-4980-ad42-b4971dad6aa4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.313048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-068a0402-e7b3-4980-ad42-b4971dad6aa4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.313239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-068a0402-e7b3-4980-ad42-b4971dad6aa4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.313339] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('068a0402-e7b3-4980-ad42-b4971dad6aa4',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.403917] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a631474-f774-4747-8676-6477b61cae29: rpc.has_security_group_logging(os_id): False [ 618.405156] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.423912] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.423912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.423912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.423912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.424153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.424707] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.424707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.424707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.424707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.424707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.424968] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.424968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.424968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.425093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.425160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.425364] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.425435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.425500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.425909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.425909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.425909] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be created. [ 618.486157] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.486157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.486157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.486575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.486801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.501293] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 618.810723] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.810924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.817491] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea05aafd-d89a-4a4a-8f6a-25194a42d3e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.817491] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 068a0402-e7b3-4980-ad42-b4971dad6aa4 with status ACTIVE [ 618.817491] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.817491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.817491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.817491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.817491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.817491] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.817491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.817491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.817851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.817851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.817851] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.817851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.817989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.818158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.818158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.818248] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 068a0402-e7b3-4980-ad42-b4971dad6aa4 is going to be updated. [ 618.844800] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.844800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.844800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.844800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.844800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.844800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-068a0402-e7b3-4980-ad42-b4971dad6aa4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.907759] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.069469] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 187f2eae-7657-4240-8ccd-728badf3526c in Status: SUCCESS [ 619.069698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.321195] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea05aafd-d89a-4a4a-8f6a-25194a42d3e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.409584] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.410139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.410139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.410139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.410139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.410139] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 619.412271] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b in Status: SUCCESS [ 619.412458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.412611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.412817] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.413011] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.413143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.413210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.413367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.413456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.413597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.413666] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4a2c13a-9225-49c6-996f-0d53b89aa94b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.441168] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.441419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.441508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.441730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.441891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.452411] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 619.827526] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.827526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.827526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.827526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.827526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.827526] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 is going to be created. [ 619.859298] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.861517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.861517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.861517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.861517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.876659] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 in Status: UNINITIALIZED for 2s [ 619.916484] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4a2c13a-9225-49c6-996f-0d53b89aa94b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.919420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.919420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.919420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.919524] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.919773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.919773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.919844] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.919916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.920199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.920199] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4a2c13a-9225-49c6-996f-0d53b89aa94b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.920373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.920373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.920438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.920574] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.920664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.920723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.920853] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.920927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.921013] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.921110] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4a2c13a-9225-49c6-996f-0d53b89aa94b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.348238] env[67003]: INFO networking_nsxv3.common.synchronization [None req-de1b0189-a996-4248-9e44-286f23819a7e None None] Enqueued Resource ID: 26fb9c2e-b2ac-4bc9-b1c0-371778c20ac4 with Priority: HIGHEST for action port [ 620.348238] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26fb9c2e-b2ac-4bc9-b1c0-371778c20ac4 with Priority: HIGHEST for action port [ 620.348238] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-26fb9c2e-b2ac-4bc9-b1c0-371778c20ac4 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.348238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26fb9c2e-b2ac-4bc9-b1c0-371778c20ac4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.348238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26fb9c2e-b2ac-4bc9-b1c0-371778c20ac4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.348238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26fb9c2e-b2ac-4bc9-b1c0-371778c20ac4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.348238] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26fb9c2e-b2ac-4bc9-b1c0-371778c20ac4',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.381268] env[67003]: INFO networking_nsxv3.common.synchronization [req-8be240b8-6978-47f5-b691-ccee67eef63a req-4a64df4b-63cd-45a4-b902-d82533395249 tempest-VolumesAssistedSnapshotsTest-908302373 tempest-VolumesAssistedSnapshotsTest-908302373-project-member] Enqueued Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGHEST for action security_group_members [ 620.381632] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGHEST for action security_group_members [ 620.381964] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a279ae9a-5f5b-4b3f-a403-fcef8683474d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.382146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.382222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.382668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.382908] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.383064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.383165] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.383389] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.383905] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.383905] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a279ae9a-5f5b-4b3f-a403-fcef8683474d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.419349] env[67003]: INFO networking_nsxv3.common.synchronization [None req-1ac3bb09-2ce7-4307-936f-c124835e2da9 None None] Enqueued Resource ID: e5d27659-5081-424a-8e28-d46ad4865c27 with Priority: HIGHEST for action port [ 620.419622] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5d27659-5081-424a-8e28-d46ad4865c27 with Priority: HIGHEST for action port [ 620.420449] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5d27659-5081-424a-8e28-d46ad4865c27 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.421161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5d27659-5081-424a-8e28-d46ad4865c27" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.421161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5d27659-5081-424a-8e28-d46ad4865c27" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.421161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5d27659-5081-424a-8e28-d46ad4865c27" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.421161] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5d27659-5081-424a-8e28-d46ad4865c27',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.426297] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4a2c13a-9225-49c6-996f-0d53b89aa94b: rpc.has_security_group_logging(os_id): False [ 620.448631] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.448631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.448631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.448864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.448864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.449080] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.449181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.449248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.449651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.449731] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.449914] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.450017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.450088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.450233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.450308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.450557] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.450700] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.450818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.451033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.452576] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.452576] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b is going to be created. [ 620.529268] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 620.529268] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.529268] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.529539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.529660] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.539808] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.539808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.539808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.539808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.539808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.550535] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b in Status: IN_PROGRESS for 2s [ 620.851770] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26fb9c2e-b2ac-4bc9-b1c0-371778c20ac4 [ 620.851770] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.851770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.851770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.851770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.851770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.851770] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26fb9c2e-b2ac-4bc9-b1c0-371778c20ac4 already deleted. [ 620.851770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26fb9c2e-b2ac-4bc9-b1c0-371778c20ac4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.887832] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.888013] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.888128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.888393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.888491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.888814] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.888814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.888949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.888997] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.889108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.889328] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d already deleted. [ 620.889328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.923367] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e5d27659-5081-424a-8e28-d46ad4865c27 [ 620.923646] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.923827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.923917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.924165] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.924297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.924410] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e5d27659-5081-424a-8e28-d46ad4865c27 already deleted. [ 620.924501] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5d27659-5081-424a-8e28-d46ad4865c27" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.033521] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.033637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.466682] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 621.466682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.466682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.467403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.467403] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.467403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.467403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.467403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.467403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.467843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.467843] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.719019] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-754 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.719273] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-754" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.719464] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-754" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.719842] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-754" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.720896] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.721233] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.721528] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.721819] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.722049] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.722699] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.722699] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 621.722699] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 621.722901] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 621.723092] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 621.723356] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 621.723573] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 621.762710] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 621.763029] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.039 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 621.763195] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 621.763442] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-754" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.764570] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-6e297a79-c35e-4e19-bbe3-1460d8aa63c7 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.764771] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-6e297a79-c35e-4e19-bbe3-1460d8aa63c7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.764907] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-6e297a79-c35e-4e19-bbe3-1460d8aa63c7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.765357] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-6e297a79-c35e-4e19-bbe3-1460d8aa63c7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.765470] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e297a79-c35e-4e19-bbe3-1460d8aa63c7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.886641] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 in Status: SUCCESS [ 621.886641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.886803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.887333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.887333] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.887475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.887475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.887689] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.887788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.887880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.887972] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea05aafd-d89a-4a4a-8f6a-25194a42d3e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.970530] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.970648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.970648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.972122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.972122] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.972122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.972122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.972122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.972122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.972122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.972521] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.972521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.972609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.972786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.973026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.974123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.974123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.974312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.976042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.976042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.976042] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.268641] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.268641] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.268641] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.269702] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.269885] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.270061] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 6e297a79-c35e-4e19-bbe3-1460d8aa63c7 not found, creating... [ 622.270368] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.270495] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.270599] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.270931] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.271163] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.271539] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.271755] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.271920] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.272219] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.272365] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.272504] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 6e297a79-c35e-4e19-bbe3-1460d8aa63c7 is going to be created. [ 622.298391] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.298554] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.298799] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.298956] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.299210] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.299433] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-6e297a79-c35e-4e19-bbe3-1460d8aa63c7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.367976] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e8ff8696-d7cf-4856-a9ee-48426385bc8e None None] Enqueued Resource ID: e8039365-ff55-4438-ad36-2943cb3b28cc with Priority: HIGHEST for action port [ 622.369496] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8039365-ff55-4438-ad36-2943cb3b28cc with Priority: HIGHEST for action port [ 622.369682] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8039365-ff55-4438-ad36-2943cb3b28cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.369867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8039365-ff55-4438-ad36-2943cb3b28cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.369983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8039365-ff55-4438-ad36-2943cb3b28cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.370347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8039365-ff55-4438-ad36-2943cb3b28cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.370450] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8039365-ff55-4438-ad36-2943cb3b28cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.392305] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.392523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.392523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.392660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.392844] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.392983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.393079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.393244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.393330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.393420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.393574] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.393673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.393734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.393915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.394095] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.394195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.394258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.394404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.394482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.394567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.394659] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea05aafd-d89a-4a4a-8f6a-25194a42d3e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.431903] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e7a5673e-149b-425c-b12e-6c5f800aa5e1 None None] Enqueued Resource ID: 769a98d3-c056-4063-9959-c1baa12bfb13 with Priority: HIGHEST for action port [ 622.432206] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769a98d3-c056-4063-9959-c1baa12bfb13 with Priority: HIGHEST for action port [ 622.432507] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-769a98d3-c056-4063-9959-c1baa12bfb13 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.432651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-769a98d3-c056-4063-9959-c1baa12bfb13" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.432700] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-769a98d3-c056-4063-9959-c1baa12bfb13" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.433360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-769a98d3-c056-4063-9959-c1baa12bfb13" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.433499] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('769a98d3-c056-4063-9959-c1baa12bfb13',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.478529] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a631474-f774-4747-8676-6477b61cae29: rpc.has_security_group_logging(os_id): False [ 622.498985] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.499199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.499496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.499609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.499664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.499949] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.500097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.500201] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.500377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.500676] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.500770] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.500821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.500908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.501089] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.501191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.501502] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.501883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.501883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.501883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.502753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.502753] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 622.585171] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b in Status: SUCCESS [ 622.585171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.591238] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.591238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.591238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.591238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.591238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.602470] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 622.873814] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8039365-ff55-4438-ad36-2943cb3b28cc [ 622.874178] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.874327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.874404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.874615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.874703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.874794] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8039365-ff55-4438-ad36-2943cb3b28cc already deleted. [ 622.874870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8039365-ff55-4438-ad36-2943cb3b28cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.898392] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea05aafd-d89a-4a4a-8f6a-25194a42d3e1: rpc.has_security_group_logging(os_id): False [ 622.920215] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.920431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.920431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.920994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.920994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.920994] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.921206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.921206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.923450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.923450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.923450] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.923450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.923450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.923450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.923450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.923450] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.923450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.923450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.923909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.923909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.923909] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 is going to be created. [ 622.937582] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 769a98d3-c056-4063-9959-c1baa12bfb13 [ 622.938894] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.938894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.938894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.939266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.939422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.939533] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:769a98d3-c056-4063-9959-c1baa12bfb13 already deleted. [ 622.939623] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-769a98d3-c056-4063-9959-c1baa12bfb13" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.988361] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.988361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.988361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.988361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.988361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.998022] env[67003]: INFO networking_nsxv3.common.synchronization [req-8be240b8-6978-47f5-b691-ccee67eef63a req-b6d35306-1f90-4c68-a0a7-503c76302e93 service nova] Enqueued Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGHEST for action security_group_rules [ 622.998022] env[67003]: INFO networking_nsxv3.common.synchronization [req-8be240b8-6978-47f5-b691-ccee67eef63a req-b6d35306-1f90-4c68-a0a7-503c76302e93 service nova] Enqueued Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGHEST for action security_group_members [ 622.998022] env[67003]: INFO networking_nsxv3.common.synchronization [req-8be240b8-6978-47f5-b691-ccee67eef63a req-b6d35306-1f90-4c68-a0a7-503c76302e93 service nova] Enqueued Resource ID: 6e297a79-c35e-4e19-bbe3-1460d8aa63c7 with Priority: HIGHEST for action port [ 622.998022] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGHEST for action security_group_rules [ 622.998022] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGHEST for action security_group_members [ 622.998022] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e297a79-c35e-4e19-bbe3-1460d8aa63c7 with Priority: HIGHEST for action port [ 622.998022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.998022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.998022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.998022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.998022] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a279ae9a-5f5b-4b3f-a403-fcef8683474d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.999437] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a279ae9a-5f5b-4b3f-a403-fcef8683474d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.999956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.000221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.000657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.001886] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.002447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.003674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.003992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.004107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.004212] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a279ae9a-5f5b-4b3f-a403-fcef8683474d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.005195] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e297a79-c35e-4e19-bbe3-1460d8aa63c7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.005330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e297a79-c35e-4e19-bbe3-1460d8aa63c7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.005395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e297a79-c35e-4e19-bbe3-1460d8aa63c7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.005544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e297a79-c35e-4e19-bbe3-1460d8aa63c7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.005616] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e297a79-c35e-4e19-bbe3-1460d8aa63c7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.009302] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 in Status: IN_PROGRESS for 2s [ 623.452115] env[67003]: INFO networking_nsxv3.common.synchronization [req-3951dfa6-f333-412c-9ac3-8b7744759a60 req-6d0a0b26-7b49-4553-9281-4313ee15d20e tempest-AttachInterfacesV270Test-1056224786 tempest-AttachInterfacesV270Test-1056224786-project-member] Enqueued Resource ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 with Priority: HIGHEST for action security_group_members [ 623.452115] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 with Priority: HIGHEST for action security_group_members [ 623.452115] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.452115] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.452115] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.453169] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.453341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.453449] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.453511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.453711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.453764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.453873] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032f92e2-50d8-4e5f-901e-8c80dbcfbdf5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.508519] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a279ae9a-5f5b-4b3f-a403-fcef8683474d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.508819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.510049] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a279ae9a-5f5b-4b3f-a403-fcef8683474d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.511212] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e297a79-c35e-4e19-bbe3-1460d8aa63c7 with status ACTIVE [ 623.511468] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.511628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.511791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.512506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.514966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.514966] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.514966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.514966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.514966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.514966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.514966] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.514966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.514966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.514966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.514966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.514966] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e297a79-c35e-4e19-bbe3-1460d8aa63c7 is going to be updated. [ 623.543477] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.543931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.544340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.546494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.546494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.546494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e297a79-c35e-4e19-bbe3-1460d8aa63c7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.859133] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-48 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.859349] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-48" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.859475] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-48" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.860513] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-48" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.860513] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.864376] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.864376] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.864376] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.864376] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.864376] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.864376] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.864376] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.864376] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.864376] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.864376] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.864376] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.890208] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.890208] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.890208] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.890208] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-48" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.890409] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-fa9996c8-bfa8-4269-8d2b-1870e1549ba1 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.890478] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-fa9996c8-bfa8-4269-8d2b-1870e1549ba1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.890558] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-fa9996c8-bfa8-4269-8d2b-1870e1549ba1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.890879] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-fa9996c8-bfa8-4269-8d2b-1870e1549ba1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.891041] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa9996c8-bfa8-4269-8d2b-1870e1549ba1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.959906] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.960079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.960079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.960271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.960366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.960562] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.960673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.960728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.960887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.960968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.961067] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 already deleted. [ 623.961149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.018258] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a279ae9a-5f5b-4b3f-a403-fcef8683474d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.397271] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.397271] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.397271] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.397804] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.398607] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.399016] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port fa9996c8-bfa8-4269-8d2b-1870e1549ba1 not found, creating... [ 624.399538] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.401074] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.401074] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.401074] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.401074] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.401391] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.401918] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.404234] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.404234] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.404234] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.404234] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: fa9996c8-bfa8-4269-8d2b-1870e1549ba1 is going to be created. [ 624.425346] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.426334] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.426334] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.426334] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.428626] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.428626] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-fa9996c8-bfa8-4269-8d2b-1870e1549ba1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.509666] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e7787d5b-690f-4d49-9929-148fab53d351 None None] Enqueued Resource ID: 7175daa1-aedd-4b9b-b360-7744d46a3d02 with Priority: HIGHEST for action port [ 624.509666] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7175daa1-aedd-4b9b-b360-7744d46a3d02 with Priority: HIGHEST for action port [ 624.509666] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-7175daa1-aedd-4b9b-b360-7744d46a3d02 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.509666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7175daa1-aedd-4b9b-b360-7744d46a3d02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.509666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7175daa1-aedd-4b9b-b360-7744d46a3d02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.510229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7175daa1-aedd-4b9b-b360-7744d46a3d02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.510229] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7175daa1-aedd-4b9b-b360-7744d46a3d02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.521504] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.521667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.521727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.523351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.523351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.523351] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d is going to be created. [ 624.553671] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.553847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.553894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.554205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.554349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.574140] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d in Status: UNINITIALIZED for 2s [ 624.597516] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e59912b1-2602-4a8a-8da6-d163cfc80b90 None None] Enqueued Resource ID: 6edc569e-8e07-4bc0-b6c7-856e991b40c7 with Priority: HIGHEST for action port [ 624.597752] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6edc569e-8e07-4bc0-b6c7-856e991b40c7 with Priority: HIGHEST for action port [ 624.598067] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-6edc569e-8e07-4bc0-b6c7-856e991b40c7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.598526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6edc569e-8e07-4bc0-b6c7-856e991b40c7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.598602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6edc569e-8e07-4bc0-b6c7-856e991b40c7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.598864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6edc569e-8e07-4bc0-b6c7-856e991b40c7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.598952] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6edc569e-8e07-4bc0-b6c7-856e991b40c7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.617549] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 624.617773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.617919] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.618173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.618259] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.013641] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7175daa1-aedd-4b9b-b360-7744d46a3d02 [ 625.014042] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.014194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.014238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.015517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.015517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.015517] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7175daa1-aedd-4b9b-b360-7744d46a3d02 already deleted. [ 625.015517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7175daa1-aedd-4b9b-b360-7744d46a3d02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.022016] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 in Status: SUCCESS [ 625.022307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.104112] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6edc569e-8e07-4bc0-b6c7-856e991b40c7 [ 625.105476] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.105476] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.105476] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.105476] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.105476] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.105476] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6edc569e-8e07-4bc0-b6c7-856e991b40c7 already deleted. [ 625.105476] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6edc569e-8e07-4bc0-b6c7-856e991b40c7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.123541] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.123713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.123793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.124067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.124257] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.124452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.124452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.124594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.124703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.124759] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.124854] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.216683] env[67003]: INFO networking_nsxv3.common.synchronization [req-3951dfa6-f333-412c-9ac3-8b7744759a60 req-e8a5a92d-3361-4862-89a1-d67a9243e040 service nova] Enqueued Resource ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 with Priority: HIGHEST for action security_group_rules [ 625.217084] env[67003]: INFO networking_nsxv3.common.synchronization [req-3951dfa6-f333-412c-9ac3-8b7744759a60 req-e8a5a92d-3361-4862-89a1-d67a9243e040 service nova] Enqueued Resource ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 with Priority: HIGHEST for action security_group_members [ 625.217533] env[67003]: INFO networking_nsxv3.common.synchronization [req-3951dfa6-f333-412c-9ac3-8b7744759a60 req-e8a5a92d-3361-4862-89a1-d67a9243e040 service nova] Enqueued Resource ID: fa9996c8-bfa8-4269-8d2b-1870e1549ba1 with Priority: HIGHEST for action port [ 625.218460] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 with Priority: HIGHEST for action security_group_rules [ 625.218616] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 with Priority: HIGHEST for action security_group_members [ 625.218749] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa9996c8-bfa8-4269-8d2b-1870e1549ba1 with Priority: HIGHEST for action port [ 625.219081] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.219208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.219385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.220117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.220117] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('032f92e2-50d8-4e5f-901e-8c80dbcfbdf5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.220927] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.221127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.221236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.221486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.221673] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.221833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.221926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.222146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.222265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.222406] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032f92e2-50d8-4e5f-901e-8c80dbcfbdf5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.223351] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa9996c8-bfa8-4269-8d2b-1870e1549ba1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.223515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa9996c8-bfa8-4269-8d2b-1870e1549ba1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.223611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa9996c8-bfa8-4269-8d2b-1870e1549ba1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.223798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa9996c8-bfa8-4269-8d2b-1870e1549ba1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.223911] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa9996c8-bfa8-4269-8d2b-1870e1549ba1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.627969] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.628347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.628347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.628522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.628658] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.628771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.628833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.629018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.629117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.629206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.629353] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.629446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.629504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.629649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.629785] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.629888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.630176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.630176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.630176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.630359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.630359] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.726762] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('032f92e2-50d8-4e5f-901e-8c80dbcfbdf5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.729209] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.729349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.729669] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa9996c8-bfa8-4269-8d2b-1870e1549ba1 with status ACTIVE [ 625.729669] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.729816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.729860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.730326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.730326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.730326] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.730985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.730985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.730985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.730985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.730985] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.730985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.737017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.737017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.737017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.737017] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa9996c8-bfa8-4269-8d2b-1870e1549ba1 is going to be updated. [ 625.772295] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.772295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.772586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.772586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.772744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.772932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa9996c8-bfa8-4269-8d2b-1870e1549ba1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.134518] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a631474-f774-4747-8676-6477b61cae29: rpc.has_security_group_logging(os_id): False [ 626.157645] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.158551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.158551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.158551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.158732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.159050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.159268] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.159385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.159663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.159801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.160128] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.160295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.160411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.160653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.160792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.161117] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.161294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.161401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.161654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.161734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.161864] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 626.239408] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('032f92e2-50d8-4e5f-901e-8c80dbcfbdf5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.255439] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.255439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.255439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.255719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.255934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.271372] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 626.410248] env[67003]: INFO networking_nsxv3.common.synchronization [None req-085129de-cdd2-4dbd-89f4-3220e4f87789 None None] Enqueued Resource ID: 0e0ea557-eda3-45f9-b83f-e6b8f278cbfd with Priority: HIGHEST for action port [ 626.411102] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e0ea557-eda3-45f9-b83f-e6b8f278cbfd with Priority: HIGHEST for action port [ 626.412047] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e0ea557-eda3-45f9-b83f-e6b8f278cbfd taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.412286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e0ea557-eda3-45f9-b83f-e6b8f278cbfd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.412286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e0ea557-eda3-45f9-b83f-e6b8f278cbfd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.412628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e0ea557-eda3-45f9-b83f-e6b8f278cbfd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.412728] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e0ea557-eda3-45f9-b83f-e6b8f278cbfd',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.587398] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d in Status: SUCCESS [ 626.587629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.587846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.588106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.588292] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.588454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.588544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.588701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.588780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.588973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.589087] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a279ae9a-5f5b-4b3f-a403-fcef8683474d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.742702] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.743069] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.743069] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.743601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.743601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.743601] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 is going to be created. [ 626.786578] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.786728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.786813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.788720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.788720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.803433] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 in Status: UNINITIALIZED for 2s [ 626.915802] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e0ea557-eda3-45f9-b83f-e6b8f278cbfd [ 626.916084] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.916084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.916182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.916821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.916821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.916821] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e0ea557-eda3-45f9-b83f-e6b8f278cbfd already deleted. [ 626.916821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e0ea557-eda3-45f9-b83f-e6b8f278cbfd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.093071] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a279ae9a-5f5b-4b3f-a403-fcef8683474d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.432235] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e66e2d2b-b7a3-4a40-925d-853459153e47 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGHEST for action security_group_rules [ 627.432758] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGHEST for action security_group_rules [ 627.434233] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.434322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.434360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.436030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.436030] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe76f8c3-ada8-43f4-aca9-4d56d251b61c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.600575] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a279ae9a-5f5b-4b3f-a403-fcef8683474d: rpc.has_security_group_logging(os_id): False [ 627.615751] env[67003]: INFO networking_nsxv3.common.synchronization [None req-0bd803c9-c403-4b64-99fb-a01e12282bc7 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGHEST for action security_group_rules [ 627.616574] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGHEST for action security_group_rules [ 627.617231] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.617925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.620476] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.620615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.620681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.620967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.621102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.621358] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.621461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.621539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.621708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.621787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.621908] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d is going to be created. [ 627.696672] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.696858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.696931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.697162] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.697345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.712951] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d in Status: IN_PROGRESS for 2s [ 627.958706] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.959119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.959119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.959216] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.959257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.959356] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c already deleted. [ 627.959436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.960931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.960931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.960931] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe76f8c3-ada8-43f4-aca9-4d56d251b61c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.289674] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 628.289926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.348516] env[67003]: INFO networking_nsxv3.common.synchronization [None req-c1d86461-b0d2-4733-8e87-7419c57f454a tempest-ServerActionsTestJSON-1949922754 tempest-ServerActionsTestJSON-1949922754-project-member] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_rules [ 628.348636] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_rules [ 628.348945] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.349291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.349380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.349600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.349693] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.482534] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.482632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.482783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.482972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.483059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.483151] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c already deleted. [ 628.487350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.698100] env[67003]: INFO networking_nsxv3.common.synchronization [None req-a1dc949d-94ce-4a95-8c08-75e2b7ec1cfb tempest-ServerActionsTestJSON-1949922754 tempest-ServerActionsTestJSON-1949922754-project-member] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_rules [ 628.699387] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_rules [ 628.700035] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.700661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.849287] env[67003]: INFO networking_nsxv3.common.synchronization [None req-784b14b3-a510-45f0-aa56-60637aba0156 None None] Enqueued Resource ID: de97c3f7-0750-41a2-9ed0-b3675002f51d with Priority: HIGHEST for action port [ 628.849994] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de97c3f7-0750-41a2-9ed0-b3675002f51d with Priority: HIGHEST for action port [ 628.851843] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-de97c3f7-0750-41a2-9ed0-b3675002f51d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.852251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de97c3f7-0750-41a2-9ed0-b3675002f51d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.852251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de97c3f7-0750-41a2-9ed0-b3675002f51d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.852571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de97c3f7-0750-41a2-9ed0-b3675002f51d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.852720] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de97c3f7-0750-41a2-9ed0-b3675002f51d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.905762] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 in Status: SUCCESS [ 628.906106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.906223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.906433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.906631] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.906761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.907693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.907693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.907693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.907693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.907693] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('032f92e2-50d8-4e5f-901e-8c80dbcfbdf5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.919050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.919316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.919316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.919538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.919634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.919731] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 already deleted. [ 628.919818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.920017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.920185] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.920497] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.952290] env[67003]: INFO networking_nsxv3.common.synchronization [req-c7af7c67-5d97-4679-bbdb-9608bf8caefb req-088f8f4e-8948-427c-a41f-09e3c68e17db tempest-DeleteServersAdminTestJSON-1125675701 tempest-DeleteServersAdminTestJSON-1125675701-project-admin] Enqueued Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_members [ 628.952553] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_members [ 628.952856] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.953065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.953162] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.953339] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.953494] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.953590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.953648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.953830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.953968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.954944] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.976985] env[67003]: INFO networking_nsxv3.common.synchronization [req-51f50707-635b-437f-bd7d-daf021ff211f req-ea65148c-2f62-4ac8-a4e6-c41c98ec79a2 tempest-ServerPasswordTestJSON-448684487 tempest-ServerPasswordTestJSON-448684487-project-member] Enqueued Resource ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 with Priority: HIGHEST for action security_group_members [ 628.976985] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 with Priority: HIGHEST for action security_group_members [ 628.976985] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c3eec-28bb-4dcc-a740-eca86fce2578 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.976985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.977419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.977419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.977628] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.977711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.977795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.977968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.978081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.978184] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c3eec-28bb-4dcc-a740-eca86fce2578',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.356786] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port de97c3f7-0750-41a2-9ed0-b3675002f51d [ 629.357084] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.357209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.357209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.357429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.357522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.357622] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:de97c3f7-0750-41a2-9ed0-b3675002f51d already deleted. [ 629.357749] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de97c3f7-0750-41a2-9ed0-b3675002f51d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.412115] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.412312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.412391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.412635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.412835] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.413100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.413238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.413510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.413592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.413819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.414038] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.414157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.414237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.414375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.414516] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.414610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.414789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.414850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.414884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.414959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.415062] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('032f92e2-50d8-4e5f-901e-8c80dbcfbdf5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.445886] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.445886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.445886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.445886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.445886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.445886] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 already deleted. [ 629.445886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.457310] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.457474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.457542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.458099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.458099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.458099] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.458099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.458723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.458723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.458723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.458723] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 is going to be updated. [ 629.481277] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.482099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.482554] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.484655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.484781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.485386] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.485539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.485711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.485805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.485891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.485986] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 already deleted. [ 629.486087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.489439] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.489522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.489598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.490111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.490111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.500792] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: IN_PROGRESS for 2s [ 629.600252] env[67003]: INFO networking_nsxv3.common.synchronization [None req-22b44010-7250-4e79-af19-864c2c13f305 None None] Enqueued Resource ID: d7452749-a8db-453a-ad40-3fd2184f62cc with Priority: HIGHEST for action port [ 629.601651] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7452749-a8db-453a-ad40-3fd2184f62cc with Priority: HIGHEST for action port [ 629.602557] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7452749-a8db-453a-ad40-3fd2184f62cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.602797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7452749-a8db-453a-ad40-3fd2184f62cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.602988] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7452749-a8db-453a-ad40-3fd2184f62cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.603497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7452749-a8db-453a-ad40-3fd2184f62cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.603824] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7452749-a8db-453a-ad40-3fd2184f62cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.727298] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d in Status: SUCCESS [ 629.727607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.918252] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5: rpc.has_security_group_logging(os_id): False [ 629.938235] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.938413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.938478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.940194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.940194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.940194] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.940194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.940194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.940564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.940564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.940773] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.940773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.941071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.941133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.941322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.941481] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.941481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.941616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.941675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.941761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.941855] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 is going to be created. [ 630.033493] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.033493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.033493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.033493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.033493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.047169] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 in Status: IN_PROGRESS for 2s [ 630.107380] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7452749-a8db-453a-ad40-3fd2184f62cc [ 630.107380] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.107380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.107380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.107380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.107380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.107380] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7452749-a8db-453a-ad40-3fd2184f62cc already deleted. [ 630.107380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7452749-a8db-453a-ad40-3fd2184f62cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.211054] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-113 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.211241] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-113" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.211432] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-113" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.211803] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-113" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.212122] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.212586] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.212586] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.212808] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.213146] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.213301] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.213355] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 630.213459] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 630.213566] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 630.213674] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 630.213857] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 630.213923] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 630.243328] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 630.243605] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 630.243795] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 630.244064] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-113" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.244529] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-a89b8347-2d1b-4493-889f-df79624512de taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.244802] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-a89b8347-2d1b-4493-889f-df79624512de" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.245414] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-a89b8347-2d1b-4493-889f-df79624512de" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.245486] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-a89b8347-2d1b-4493-889f-df79624512de" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.245983] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a89b8347-2d1b-4493-889f-df79624512de',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.750046] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.750046] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.750046] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.750046] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.750046] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.750046] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port a89b8347-2d1b-4493-889f-df79624512de not found, creating... [ 630.750430] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.750626] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.750855] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.751145] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.751294] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.751713] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.752041] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.752231] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.752496] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.752668] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.752816] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: a89b8347-2d1b-4493-889f-df79624512de is going to be created. [ 630.801804] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.802673] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.802673] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.802673] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.802673] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.802869] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-a89b8347-2d1b-4493-889f-df79624512de" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.469941] env[67003]: INFO networking_nsxv3.common.synchronization [req-51f50707-635b-437f-bd7d-daf021ff211f req-f58470d0-13a2-4dc8-bf9c-e703ef119db3 service nova] Enqueued Resource ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 with Priority: HIGHEST for action security_group_rules [ 631.469941] env[67003]: INFO networking_nsxv3.common.synchronization [req-51f50707-635b-437f-bd7d-daf021ff211f req-f58470d0-13a2-4dc8-bf9c-e703ef119db3 service nova] Enqueued Resource ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 with Priority: HIGHEST for action security_group_members [ 631.471133] env[67003]: INFO networking_nsxv3.common.synchronization [req-51f50707-635b-437f-bd7d-daf021ff211f req-f58470d0-13a2-4dc8-bf9c-e703ef119db3 service nova] Enqueued Resource ID: a89b8347-2d1b-4493-889f-df79624512de with Priority: HIGHEST for action port [ 631.471133] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 with Priority: HIGHEST for action security_group_rules [ 631.471133] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 with Priority: HIGHEST for action security_group_members [ 631.471133] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a89b8347-2d1b-4493-889f-df79624512de with Priority: HIGHEST for action port [ 631.471133] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec7c3eec-28bb-4dcc-a740-eca86fce2578 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.471402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.471402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.471505] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.471585] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec7c3eec-28bb-4dcc-a740-eca86fce2578',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.472447] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c3eec-28bb-4dcc-a740-eca86fce2578 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.472560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.472627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.472798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.472996] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.473091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.473133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.473266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.473351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.473440] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c3eec-28bb-4dcc-a740-eca86fce2578',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.477023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-a89b8347-2d1b-4493-889f-df79624512de taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.477023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a89b8347-2d1b-4493-889f-df79624512de" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.477023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a89b8347-2d1b-4493-889f-df79624512de" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.477023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a89b8347-2d1b-4493-889f-df79624512de" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.477023] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a89b8347-2d1b-4493-889f-df79624512de',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.510660] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: SUCCESS [ 631.511427] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 deletion is rescheduled due to dependency. [ 631.511427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.894370] env[67003]: INFO networking_nsxv3.common.synchronization [req-0eebd1bd-59e1-4611-a110-197c7ddc7ad5 req-62f1f55d-8ff5-4b04-a7d2-d2697a34b7c0 tempest-ServersTestFqdnHostnames-1925503962 tempest-ServersTestFqdnHostnames-1925503962-project-member] Enqueued Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGHEST for action security_group_members [ 631.896068] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGHEST for action security_group_members [ 631.896678] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64b82baf-96b3-4d2a-a0f3-634fd5e24137 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.897041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.897285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.897755] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.899022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.899022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.899022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.899022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.899022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.899022] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64b82baf-96b3-4d2a-a0f3-634fd5e24137',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.975241] env[67003]: INFO networking_nsxv3.common.synchronization [None req-eaa8bfb2-bfd3-43a8-9ca0-f17687ba711e None None] Enqueued Resource ID: b26e41ae-891a-4f1a-b181-e26eb5c04006 with Priority: HIGHEST for action port [ 631.975847] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ec7c3eec-28bb-4dcc-a740-eca86fce2578',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.976917] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b26e41ae-891a-4f1a-b181-e26eb5c04006 with Priority: HIGHEST for action port [ 631.977790] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c3eec-28bb-4dcc-a740-eca86fce2578 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.977913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.978154] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b26e41ae-891a-4f1a-b181-e26eb5c04006 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.978262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b26e41ae-891a-4f1a-b181-e26eb5c04006" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.979111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b26e41ae-891a-4f1a-b181-e26eb5c04006" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.979111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b26e41ae-891a-4f1a-b181-e26eb5c04006" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.979111] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b26e41ae-891a-4f1a-b181-e26eb5c04006',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.981298] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a89b8347-2d1b-4493-889f-df79624512de with status ACTIVE [ 631.981298] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.981298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.981298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.981917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.982723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.985243] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.985243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.985243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.985243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.985243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.985243] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.985243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.985243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.985243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.985243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.985243] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a89b8347-2d1b-4493-889f-df79624512de is going to be updated. [ 632.010238] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.010341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.010341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.010537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.010667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.010862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a89b8347-2d1b-4493-889f-df79624512de" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.063273] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 in Status: SUCCESS [ 632.063273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.348268] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-881 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.348268] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-881" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.348268] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-881" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.348268] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-881" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.348268] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.348268] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.348818] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.349030] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.349176] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.349512] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.349564] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.351011] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.351154] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.351560] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.351560] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.351560] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.404462] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.404727] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.053 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 632.404727] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.404892] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-881" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.405298] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-6d5d8668-ab79-498c-be0d-ad1b15d3cd61 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.405650] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-6d5d8668-ab79-498c-be0d-ad1b15d3cd61" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.405650] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-6d5d8668-ab79-498c-be0d-ad1b15d3cd61" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.405916] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-6d5d8668-ab79-498c-be0d-ad1b15d3cd61" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.406897] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d5d8668-ab79-498c-be0d-ad1b15d3cd61',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.408091] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.408229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.409262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.409962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.409962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.409962] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.410181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.410181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.410348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.410407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.410530] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 already deleted. [ 632.410628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.480163] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ec7c3eec-28bb-4dcc-a740-eca86fce2578',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.488362] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b26e41ae-891a-4f1a-b181-e26eb5c04006 [ 632.488771] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.488891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.489254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.489254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.489433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.489433] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b26e41ae-891a-4f1a-b181-e26eb5c04006 already deleted. [ 632.489739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b26e41ae-891a-4f1a-b181-e26eb5c04006" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.530983] env[67003]: INFO networking_nsxv3.common.synchronization [None req-a63ac576-25d5-4a1d-a002-311858123628 tempest-ServersWithSpecificFlavorTestJSON-1477718790 tempest-ServersWithSpecificFlavorTestJSON-1477718790-project-member] Enqueued Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_rules [ 632.531506] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_rules [ 632.531818] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.531973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.532131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.532564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.532564] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.755160] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ce37a661-dd41-4a5d-a13f-538a98b43780 tempest-ServersWithSpecificFlavorTestJSON-1477718790 tempest-ServersWithSpecificFlavorTestJSON-1477718790-project-member] Enqueued Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_rules [ 632.755937] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_rules [ 632.756400] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.756544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.913256] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.913476] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.913599] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.913874] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.914631] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.914631] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 6d5d8668-ab79-498c-be0d-ad1b15d3cd61 not found, creating... [ 632.914631] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.914631] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.914923] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.914923] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.915065] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.915350] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.915490] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.915595] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.915798] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.915922] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.916080] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 6d5d8668-ab79-498c-be0d-ad1b15d3cd61 is going to be created. [ 632.937477] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.937681] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.937727] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.937974] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.938275] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.938525] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-6d5d8668-ab79-498c-be0d-ad1b15d3cd61" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.984039] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.984247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.984290] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.984487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.984573] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.984671] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 is going to be created. [ 633.029316] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.029491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.029552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.029867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.030611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.048152] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 in Status: UNINITIALIZED for 2s [ 633.070812] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.071110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.071110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.071531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.071754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.071896] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 already deleted. [ 633.072036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.072296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.072523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.072759] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.600655] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.601240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.601240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.601240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.601240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.601516] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 already deleted. [ 633.601516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.624286] env[67003]: INFO networking_nsxv3.common.synchronization [req-0eebd1bd-59e1-4611-a110-197c7ddc7ad5 req-3b9949aa-5d5e-47ff-9d1b-0c59068740be service nova] Enqueued Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGHEST for action security_group_rules [ 633.624458] env[67003]: INFO networking_nsxv3.common.synchronization [req-0eebd1bd-59e1-4611-a110-197c7ddc7ad5 req-3b9949aa-5d5e-47ff-9d1b-0c59068740be service nova] Enqueued Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGHEST for action security_group_members [ 633.624591] env[67003]: INFO networking_nsxv3.common.synchronization [req-0eebd1bd-59e1-4611-a110-197c7ddc7ad5 req-3b9949aa-5d5e-47ff-9d1b-0c59068740be service nova] Enqueued Resource ID: 6d5d8668-ab79-498c-be0d-ad1b15d3cd61 with Priority: HIGHEST for action port [ 633.625194] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGHEST for action security_group_rules [ 633.625351] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGHEST for action security_group_members [ 633.625475] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d5d8668-ab79-498c-be0d-ad1b15d3cd61 with Priority: HIGHEST for action port [ 633.625706] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.625857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.625898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.627745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.627745] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64b82baf-96b3-4d2a-a0f3-634fd5e24137',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.629284] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64b82baf-96b3-4d2a-a0f3-634fd5e24137 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.629463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.629583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.629825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.629866] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.629966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.630043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.630216] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.630305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.630419] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64b82baf-96b3-4d2a-a0f3-634fd5e24137',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.631479] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d5d8668-ab79-498c-be0d-ad1b15d3cd61 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.631550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d5d8668-ab79-498c-be0d-ad1b15d3cd61" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.631605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d5d8668-ab79-498c-be0d-ad1b15d3cd61" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.631760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d5d8668-ab79-498c-be0d-ad1b15d3cd61" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.631840] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d5d8668-ab79-498c-be0d-ad1b15d3cd61',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.018100] env[67003]: INFO networking_nsxv3.common.synchronization [req-34fd79bf-0a7a-4945-b79f-6eb09cc539ff req-bf8fe056-8270-41b2-a424-7cb45fd20237 tempest-ServerAddressesNegativeTestJSON-298726464 tempest-ServerAddressesNegativeTestJSON-298726464-project-member] Enqueued Resource ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 with Priority: HIGHEST for action security_group_members [ 634.018844] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 with Priority: HIGHEST for action security_group_members [ 634.019732] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-096a4cda-6a5e-4383-92c4-166cabe87e96 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.020043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.020141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.020498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.020729] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.020883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.020979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.021239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.021943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.022044] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('096a4cda-6a5e-4383-92c4-166cabe87e96',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.133970] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64b82baf-96b3-4d2a-a0f3-634fd5e24137 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.134255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.134429] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d5d8668-ab79-498c-be0d-ad1b15d3cd61 with status ACTIVE [ 634.134636] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.134751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.134835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.135052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.135147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.135345] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.135454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.135522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.135674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.135753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.135933] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.136061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.136116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.136251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.136320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.136832] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d5d8668-ab79-498c-be0d-ad1b15d3cd61 is going to be updated. [ 634.137576] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64b82baf-96b3-4d2a-a0f3-634fd5e24137',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.162821] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.163104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.163104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.163309] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.163448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.163635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d5d8668-ab79-498c-be0d-ad1b15d3cd61" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.520963] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-734 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.524420] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-734" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.524581] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-734" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.524991] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-734" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.525840] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.526194] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.526393] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.526800] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.527103] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.527507] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.527669] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.527861] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.528091] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.528806] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.528806] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.528806] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.531867] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.531867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.531867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.532843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.532843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.532843] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.532843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.532843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.533299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.533299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.533299] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 already deleted. [ 634.533407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.560939] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.560939] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.561369] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.561463] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-734" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.562202] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-068dfef3-472f-4be2-a9c3-8b8795ea6ec0 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.562202] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-068dfef3-472f-4be2-a9c3-8b8795ea6ec0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.562388] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-068dfef3-472f-4be2-a9c3-8b8795ea6ec0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.562857] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-068dfef3-472f-4be2-a9c3-8b8795ea6ec0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.563568] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('068dfef3-472f-4be2-a9c3-8b8795ea6ec0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.639707] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64b82baf-96b3-4d2a-a0f3-634fd5e24137',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.059562] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 in Status: SUCCESS [ 635.059894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.060122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.060370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.060639] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.060875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.060990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.061631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.061631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.061631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.061631] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ec7c3eec-28bb-4dcc-a740-eca86fce2578',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.067088] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.067288] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.067454] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.067920] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.068058] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.068747] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 068dfef3-472f-4be2-a9c3-8b8795ea6ec0 not found, creating... [ 635.068901] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.069413] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.069619] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.070315] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.070315] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.070563] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.070774] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.071150] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.071538] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.071687] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.071936] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 068dfef3-472f-4be2-a9c3-8b8795ea6ec0 is going to be created. [ 635.096411] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.096717] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.096945] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.097064] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.097298] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.097524] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-068dfef3-472f-4be2-a9c3-8b8795ea6ec0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.144086] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.144086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.144086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.144470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.144470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.144470] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 is going to be created. [ 635.189184] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.189362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.189406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.189677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.189860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.207865] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 in Status: UNINITIALIZED for 2s [ 635.564814] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c3eec-28bb-4dcc-a740-eca86fce2578 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.564932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.564975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.565218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.565396] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.565567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.565567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.565913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.565913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.565913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.566093] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c3eec-28bb-4dcc-a740-eca86fce2578 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.566192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.566251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.566397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.566537] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.566637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.566692] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.566828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.566914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.566989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.567098] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ec7c3eec-28bb-4dcc-a740-eca86fce2578',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.838097] env[67003]: INFO networking_nsxv3.common.synchronization [req-34fd79bf-0a7a-4945-b79f-6eb09cc539ff req-a71ca6ad-7bc2-4a9b-8a91-fb42d3279b4a service nova] Enqueued Resource ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 with Priority: HIGHEST for action security_group_rules [ 635.838405] env[67003]: INFO networking_nsxv3.common.synchronization [req-34fd79bf-0a7a-4945-b79f-6eb09cc539ff req-a71ca6ad-7bc2-4a9b-8a91-fb42d3279b4a service nova] Enqueued Resource ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 with Priority: HIGHEST for action security_group_members [ 635.838405] env[67003]: INFO networking_nsxv3.common.synchronization [req-34fd79bf-0a7a-4945-b79f-6eb09cc539ff req-a71ca6ad-7bc2-4a9b-8a91-fb42d3279b4a service nova] Enqueued Resource ID: 068dfef3-472f-4be2-a9c3-8b8795ea6ec0 with Priority: HIGHEST for action port [ 635.839203] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 with Priority: HIGHEST for action security_group_rules [ 635.839365] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 with Priority: HIGHEST for action security_group_members [ 635.840174] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 068dfef3-472f-4be2-a9c3-8b8795ea6ec0 with Priority: HIGHEST for action port [ 635.840309] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-096a4cda-6a5e-4383-92c4-166cabe87e96 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.840387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.840460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.843478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.843478] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('096a4cda-6a5e-4383-92c4-166cabe87e96',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.843478] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-096a4cda-6a5e-4383-92c4-166cabe87e96 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.843478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.843478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.843478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.843478] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.843478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.843478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.843478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.843478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.843478] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('096a4cda-6a5e-4383-92c4-166cabe87e96',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.844409] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-068dfef3-472f-4be2-a9c3-8b8795ea6ec0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.844409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-068dfef3-472f-4be2-a9c3-8b8795ea6ec0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.844409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-068dfef3-472f-4be2-a9c3-8b8795ea6ec0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.844653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-068dfef3-472f-4be2-a9c3-8b8795ea6ec0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.844731] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('068dfef3-472f-4be2-a9c3-8b8795ea6ec0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.070165] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ec7c3eec-28bb-4dcc-a740-eca86fce2578: rpc.has_security_group_logging(os_id): False [ 636.089338] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.089519] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.089613] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.089874] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.089993] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.090272] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.090787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.090787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.090787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.090787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.091025] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.091128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.091212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.091392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.091492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.091746] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.091869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.091951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.092150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.094175] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.094175] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 is going to be created. [ 636.155055] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.155055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.155055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.155055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.155055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.167810] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 in Status: IN_PROGRESS for 2s [ 636.346513] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-096a4cda-6a5e-4383-92c4-166cabe87e96 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.348509] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.348803] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('096a4cda-6a5e-4383-92c4-166cabe87e96',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.350316] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 068dfef3-472f-4be2-a9c3-8b8795ea6ec0 with status ACTIVE [ 636.350461] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.350583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.350583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.350789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.350877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.351727] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.353277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.353277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.353426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.353488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.354449] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.354594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.354680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.354917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.354917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.355071] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 068dfef3-472f-4be2-a9c3-8b8795ea6ec0 is going to be updated. [ 636.378148] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.378329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.378399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.379421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.379421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.379421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-068dfef3-472f-4be2-a9c3-8b8795ea6ec0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.857789] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('096a4cda-6a5e-4383-92c4-166cabe87e96',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.220136] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 in Status: SUCCESS [ 637.220136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.220717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.220910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.221277] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.221460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.221609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.221885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.222066] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.222255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.223160] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64b82baf-96b3-4d2a-a0f3-634fd5e24137',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.361644] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.361811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.361887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.362137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.362236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.362336] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 is going to be created. [ 637.400608] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.400608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.400608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.400881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.400931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.412461] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 in Status: UNINITIALIZED for 2s [ 637.692620] env[67003]: INFO networking_nsxv3.common.synchronization [None req-0e02dcc0-55e9-4ee0-ac29-59b486d08aab None None] Enqueued Resource ID: 04cfd1b6-7af8-4ca5-9626-82b189fee8c8 with Priority: HIGHEST for action port [ 637.693376] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04cfd1b6-7af8-4ca5-9626-82b189fee8c8 with Priority: HIGHEST for action port [ 637.693600] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-04cfd1b6-7af8-4ca5-9626-82b189fee8c8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.693756] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04cfd1b6-7af8-4ca5-9626-82b189fee8c8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.693756] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04cfd1b6-7af8-4ca5-9626-82b189fee8c8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.697104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04cfd1b6-7af8-4ca5-9626-82b189fee8c8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.697311] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04cfd1b6-7af8-4ca5-9626-82b189fee8c8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.727049] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64b82baf-96b3-4d2a-a0f3-634fd5e24137',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.182939] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 in Status: SUCCESS [ 638.183349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.200128] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04cfd1b6-7af8-4ca5-9626-82b189fee8c8 [ 638.200404] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.200615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.200693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.200918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.201039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.201125] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04cfd1b6-7af8-4ca5-9626-82b189fee8c8 already deleted. [ 638.201210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04cfd1b6-7af8-4ca5-9626-82b189fee8c8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.229311] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64b82baf-96b3-4d2a-a0f3-634fd5e24137: rpc.has_security_group_logging(os_id): False [ 638.249215] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.249372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.249447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.249661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.249786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.249993] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.250418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.250481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.250698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.250753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.250831] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 is going to be created. [ 638.309611] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.309781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.309822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.310032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.310216] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.322347] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 in Status: IN_PROGRESS for 2s [ 639.424904] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 in Status: SUCCESS [ 639.425372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.425443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.425633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.425852] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.426013] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.426128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.426329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.426445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.426556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.426652] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('096a4cda-6a5e-4383-92c4-166cabe87e96',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.755024] env[67003]: INFO networking_nsxv3.common.synchronization [req-7ce9f5ca-8f91-4c82-8d71-ab0e07967151 req-1b9ac750-eb71-4267-aa6e-06da0ee0deb8 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGHEST for action security_group_members [ 639.755656] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGHEST for action security_group_members [ 639.755975] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.758156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.758201] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.758485] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.758645] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.758760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.758826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.758990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.759093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.759193] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe76f8c3-ada8-43f4-aca9-4d56d251b61c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.931468] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-096a4cda-6a5e-4383-92c4-166cabe87e96 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.932144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.932144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.932144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.932144] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.932409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.932472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.932768] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.932916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.933133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.933456] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-096a4cda-6a5e-4383-92c4-166cabe87e96 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.933532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.933628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.933834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.934064] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.934229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.934342] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.934949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.934949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.934949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.934949] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('096a4cda-6a5e-4383-92c4-166cabe87e96',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.210055] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.210253] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.210380] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.210702] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.210962] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.211154] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.211276] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.211495] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.211695] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.211839] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.211948] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 640.213373] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 640.214685] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 640.214685] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 640.214685] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 640.214831] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 640.238345] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 640.238345] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 640.239210] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 640.239210] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.239210] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.239410] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.239801] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.239801] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.239974] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.262546] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.262546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.262546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.262802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.262802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.262903] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.262984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.263072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.263977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.264321] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.264449] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c already deleted. [ 640.264686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.342543] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 in Status: SUCCESS [ 640.342543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.437865] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 096a4cda-6a5e-4383-92c4-166cabe87e96: rpc.has_security_group_logging(os_id): False [ 640.459204] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.459204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.459204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.459204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.459204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.459204] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.459543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.459543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.459606] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.459695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.459876] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.459974] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.460108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.460258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.460329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.460507] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.460591] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.460649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.460786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.462037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.462037] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 is going to be created. [ 640.527133] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.527299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.527391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.527634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.527818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.541679] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 in Status: IN_PROGRESS for 2s [ 640.744404] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.744404] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.744547] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.746537] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.746537] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.747062] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd not found, creating... [ 640.747594] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.747828] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.747954] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.748292] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.748386] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.748711] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.748874] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.748992] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.749232] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.750137] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.750137] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd is going to be created. [ 640.788264] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.788264] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.788264] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.788264] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.788264] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.788264] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.836605] env[67003]: INFO networking_nsxv3.common.synchronization [None req-c9f852bc-761f-4a33-aa85-5a53cb98d8bf None None] Enqueued Resource ID: a0234e27-cd85-4513-a1dc-a0857ae6b316 with Priority: HIGHEST for action port [ 640.841624] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0234e27-cd85-4513-a1dc-a0857ae6b316 with Priority: HIGHEST for action port [ 640.841624] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0234e27-cd85-4513-a1dc-a0857ae6b316 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.841624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0234e27-cd85-4513-a1dc-a0857ae6b316" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.841624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0234e27-cd85-4513-a1dc-a0857ae6b316" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.841624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0234e27-cd85-4513-a1dc-a0857ae6b316" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.841624] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0234e27-cd85-4513-a1dc-a0857ae6b316',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.343336] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0234e27-cd85-4513-a1dc-a0857ae6b316 [ 641.343577] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.343749] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.343852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.344076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.344193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.344296] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0234e27-cd85-4513-a1dc-a0857ae6b316 already deleted. [ 641.344389] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0234e27-cd85-4513-a1dc-a0857ae6b316" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.541391] env[67003]: INFO networking_nsxv3.common.synchronization [req-7ce9f5ca-8f91-4c82-8d71-ab0e07967151 req-e7291173-ff28-40ce-a8fa-819a14858ca6 service nova] Enqueued Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGHEST for action security_group_rules [ 641.541391] env[67003]: INFO networking_nsxv3.common.synchronization [req-7ce9f5ca-8f91-4c82-8d71-ab0e07967151 req-e7291173-ff28-40ce-a8fa-819a14858ca6 service nova] Enqueued Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGHEST for action security_group_members [ 641.541391] env[67003]: INFO networking_nsxv3.common.synchronization [req-7ce9f5ca-8f91-4c82-8d71-ab0e07967151 req-e7291173-ff28-40ce-a8fa-819a14858ca6 service nova] Enqueued Resource ID: d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd with Priority: HIGHEST for action port [ 641.541391] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGHEST for action security_group_rules [ 641.541391] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGHEST for action security_group_members [ 641.541391] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd with Priority: HIGHEST for action port [ 641.541391] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.541391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.541391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.542246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.542465] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe76f8c3-ada8-43f4-aca9-4d56d251b61c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.546121] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.546121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.546121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.546121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.546121] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.546121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.546121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.546121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.546121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.546121] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe76f8c3-ada8-43f4-aca9-4d56d251b61c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.546121] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.546121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.546121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.546121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.546121] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.049255] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd with status ACTIVE [ 642.049516] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.049654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.049724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.049957] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.050075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.050278] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.050433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.050433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.050616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.050831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.050831] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.050933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.051022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.051250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.051320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.051423] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd is going to be updated. [ 642.054672] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe76f8c3-ada8-43f4-aca9-4d56d251b61c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.055733] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.056787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.081457] env[67003]: INFO networking_nsxv3.common.synchronization [req-35e70cb4-ac8a-407b-96de-363d84a6c0f0 req-7389d8f4-6146-4b3d-a47c-29a9e5e7720d tempest-ServerActionsTestJSON-1949922754 tempest-ServerActionsTestJSON-1949922754-project-member] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 642.081558] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 642.081952] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.081952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.082154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.082323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.082508] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.082912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.082912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.082912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.082912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.083073] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.085432] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.085432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.085432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.085598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.085776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.089022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6691a94-b646-4a9c-9ce2-ac06e2f6e2fd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.125920] env[67003]: INFO networking_nsxv3.common.synchronization [req-09917273-d7e8-4aae-a108-e4b1fa4073b2 req-88f03f62-1c57-4c8f-8b30-185c51ed6018 tempest-ServerDiagnosticsNegativeTest-419304698 tempest-ServerDiagnosticsNegativeTest-419304698-project-member] Enqueued Resource ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b with Priority: HIGHEST for action security_group_members [ 642.126482] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b with Priority: HIGHEST for action security_group_members [ 642.126775] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4a2c13a-9225-49c6-996f-0d53b89aa94b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.126884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.128747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.128747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.128747] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.128747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.128747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.128747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.128747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.128747] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4a2c13a-9225-49c6-996f-0d53b89aa94b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.475056] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.475210] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.475294] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.475642] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.475903] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.476136] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.476304] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.476523] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.477268] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.477268] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.477268] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.477268] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.477268] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.477268] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.477785] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.478019] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.510615] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.510838] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 642.510985] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.511404] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.511565] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-96747064-d55f-4d22-b9cc-83b9ff06472b taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.511875] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-96747064-d55f-4d22-b9cc-83b9ff06472b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.512133] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-96747064-d55f-4d22-b9cc-83b9ff06472b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.512408] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-96747064-d55f-4d22-b9cc-83b9ff06472b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.512583] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96747064-d55f-4d22-b9cc-83b9ff06472b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.555249] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 in Status: SUCCESS [ 642.555657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.557995] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe76f8c3-ada8-43f4-aca9-4d56d251b61c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.589081] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.589317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.589490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.589880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.590125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.590691] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.590781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.591222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.591297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.591462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.591648] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 already deleted. [ 642.591855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.631260] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.631260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.631260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.631555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.631555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.631676] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.631735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.631780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.631904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.632021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.632082] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b is going to be updated. [ 642.665751] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.665955] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.665955] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.666275] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.666490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.676673] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b in Status: IN_PROGRESS for 2s [ 643.015589] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.016520] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.016721] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.017057] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.017259] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.017439] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 96747064-d55f-4d22-b9cc-83b9ff06472b not found, creating... [ 643.017973] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.018204] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.018357] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.018633] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.018807] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.019148] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.019442] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.019601] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.019818] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.019950] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.020148] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 96747064-d55f-4d22-b9cc-83b9ff06472b is going to be created. [ 643.040268] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.040482] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.040669] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.041274] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.041711] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.042013] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-96747064-d55f-4d22-b9cc-83b9ff06472b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.060764] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.060972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.061161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.061268] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.061334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.061434] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c is going to be created. [ 643.087967] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.088202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.088202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.088422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.088584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.107806] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c in Status: UNINITIALIZED for 2s [ 643.591099] env[67003]: INFO networking_nsxv3.common.synchronization [req-bd2d8160-f0cf-4e9f-80ba-776e94dfcd5e req-2511d875-bc2e-450a-87de-a301dfcffb06 tempest-TenantUsagesTestJSON-1385717003 tempest-TenantUsagesTestJSON-1385717003-project-member] Enqueued Resource ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 with Priority: HIGHEST for action security_group_members [ 643.591099] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 with Priority: HIGHEST for action security_group_members [ 643.591099] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-43ab13f3-ab08-40ca-8026-84efbca23b63 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.591099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.591099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.591099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.592405] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.592405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.592405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.592405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.592405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.592405] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('43ab13f3-ab08-40ca-8026-84efbca23b63',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.820328] env[67003]: INFO networking_nsxv3.common.synchronization [req-35e70cb4-ac8a-407b-96de-363d84a6c0f0 req-aa3e92aa-7ffe-4fe1-ae7c-a08b9dc91d1c service nova] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_rules [ 643.822524] env[67003]: INFO networking_nsxv3.common.synchronization [req-35e70cb4-ac8a-407b-96de-363d84a6c0f0 req-aa3e92aa-7ffe-4fe1-ae7c-a08b9dc91d1c service nova] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 643.822524] env[67003]: INFO networking_nsxv3.common.synchronization [req-35e70cb4-ac8a-407b-96de-363d84a6c0f0 req-aa3e92aa-7ffe-4fe1-ae7c-a08b9dc91d1c service nova] Enqueued Resource ID: 96747064-d55f-4d22-b9cc-83b9ff06472b with Priority: HIGHEST for action port [ 643.822524] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_rules [ 643.822524] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 643.822524] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96747064-d55f-4d22-b9cc-83b9ff06472b with Priority: HIGHEST for action port [ 643.823024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.823181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.823311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.823604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.823718] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.825202] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.825353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.825407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.826037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.828035] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.828035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.828035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.828035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.828035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.828035] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.829926] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-96747064-d55f-4d22-b9cc-83b9ff06472b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.829926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96747064-d55f-4d22-b9cc-83b9ff06472b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.829926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96747064-d55f-4d22-b9cc-83b9ff06472b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.830699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96747064-d55f-4d22-b9cc-83b9ff06472b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.830699] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96747064-d55f-4d22-b9cc-83b9ff06472b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.096124] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.096124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.096124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.096426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.096426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.096632] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.096740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.096803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.097045] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.097089] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.097257] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 is going to be updated. [ 644.125456] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.125456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.125456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.125685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.125903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.136685] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 in Status: IN_PROGRESS for 2s [ 644.335896] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.335896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.335896] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.335896] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96747064-d55f-4d22-b9cc-83b9ff06472b with status ACTIVE [ 644.335896] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.335896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.335896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.335896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.335896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.335896] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.335896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.335896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.336600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.336600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.336600] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.336600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.336600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.336600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.336600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.336835] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96747064-d55f-4d22-b9cc-83b9ff06472b is going to be updated. [ 644.361253] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.361426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.361488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.361727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.361873] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.362083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96747064-d55f-4d22-b9cc-83b9ff06472b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.424998] env[67003]: INFO networking_nsxv3.common.synchronization [req-d638a30d-4086-48ec-b1cb-a789e78bffa0 req-00ae689f-b297-45d1-a0bf-c24721570d4a tempest-ServersAdminTestJSON-1432619756 tempest-ServersAdminTestJSON-1432619756-project-member] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 644.425336] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 644.425654] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.425766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.425853] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.426131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.426289] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.426394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.426455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.426611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.426695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.426788] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.686667] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b in Status: IN_PROGRESS for 4s [ 644.822094] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-329 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.822293] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.822437] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.823019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.823019] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.823374] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.824017] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.824017] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.824017] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.824268] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.824365] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 644.824531] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 644.824581] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 644.824669] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 644.824755] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 644.824983] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 644.840319] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.848177] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 644.848375] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 644.848515] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 644.848717] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.849080] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-fa124dc4-bafc-4b67-9c0f-eaa9a993815b taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.849347] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-fa124dc4-bafc-4b67-9c0f-eaa9a993815b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.849488] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-fa124dc4-bafc-4b67-9c0f-eaa9a993815b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.849818] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-fa124dc4-bafc-4b67-9c0f-eaa9a993815b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.849958] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa124dc4-bafc-4b67-9c0f-eaa9a993815b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.930792] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.930792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.930792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.930792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.931754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.933718] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.933718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.933718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.933718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.933718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.933718] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 already deleted. [ 644.933718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.122156] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c in Status: SUCCESS [ 645.123027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.123027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.123430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.123430] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.123566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.123622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.123932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.124059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.124185] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.124313] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe76f8c3-ada8-43f4-aca9-4d56d251b61c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.342627] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.342828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.342903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.343217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.343327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.343410] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 is going to be created. [ 645.354174] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.355081] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.355233] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.355558] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.355930] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.356240] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port fa124dc4-bafc-4b67-9c0f-eaa9a993815b not found, creating... [ 645.356590] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.356841] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.357012] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.357361] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.357630] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.358190] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.358190] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.358441] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.358608] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.358778] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.359030] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: fa124dc4-bafc-4b67-9c0f-eaa9a993815b is going to be created. [ 645.370637] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.370836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.370911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.371167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.371341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.381606] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.381606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.381606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.381850] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.381983] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.382602] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-fa124dc4-bafc-4b67-9c0f-eaa9a993815b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.384664] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: UNINITIALIZED for 2s [ 645.627804] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe76f8c3-ada8-43f4-aca9-4d56d251b61c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.131039] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe76f8c3-ada8-43f4-aca9-4d56d251b61c: rpc.has_security_group_logging(os_id): False [ 646.155131] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 in Status: SUCCESS [ 646.155538] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 deletion is rescheduled due to dependency. [ 646.155710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.161702] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.161702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.161702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.161702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.161702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.161702] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.161702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.161702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.161702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.162961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.162961] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c is going to be created. [ 646.192230] env[67003]: INFO networking_nsxv3.common.synchronization [req-d638a30d-4086-48ec-b1cb-a789e78bffa0 req-027ef2d7-ff70-49f8-99e7-cf4c796d3e3e service nova] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_rules [ 646.192481] env[67003]: INFO networking_nsxv3.common.synchronization [req-d638a30d-4086-48ec-b1cb-a789e78bffa0 req-027ef2d7-ff70-49f8-99e7-cf4c796d3e3e service nova] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 646.192629] env[67003]: INFO networking_nsxv3.common.synchronization [req-d638a30d-4086-48ec-b1cb-a789e78bffa0 req-027ef2d7-ff70-49f8-99e7-cf4c796d3e3e service nova] Enqueued Resource ID: fa124dc4-bafc-4b67-9c0f-eaa9a993815b with Priority: HIGHEST for action port [ 646.193512] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_rules [ 646.193721] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 646.193892] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa124dc4-bafc-4b67-9c0f-eaa9a993815b with Priority: HIGHEST for action port [ 646.194327] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.194620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.194748] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.195296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.195296] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.196458] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.197303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.197303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.197618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.197854] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.199071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.199071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.199071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.199071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.199071] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.201335] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa124dc4-bafc-4b67-9c0f-eaa9a993815b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.201335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa124dc4-bafc-4b67-9c0f-eaa9a993815b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.201335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa124dc4-bafc-4b67-9c0f-eaa9a993815b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.201335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa124dc4-bafc-4b67-9c0f-eaa9a993815b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.201335] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa124dc4-bafc-4b67-9c0f-eaa9a993815b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.298380] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.298380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.298380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.298380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.298380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.313535] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c in Status: IN_PROGRESS for 2s [ 646.700785] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b in Status: SUCCESS [ 646.700785] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b deletion is rescheduled due to dependency. [ 646.702504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.706987] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.708418] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.708846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.709069] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa124dc4-bafc-4b67-9c0f-eaa9a993815b with status ACTIVE [ 646.709600] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.709600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.709600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.710068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.710198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.710589] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.710777] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.710902] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.711208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.711300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.711901] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.711901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.711901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.711901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.713487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.713487] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa124dc4-bafc-4b67-9c0f-eaa9a993815b is going to be updated. [ 646.735595] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.735821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.735821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.736069] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.736269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.736374] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa124dc4-bafc-4b67-9c0f-eaa9a993815b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.210318] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.259592] env[67003]: INFO networking_nsxv3.common.synchronization [req-add72353-5301-4add-8b41-6f830d32ef96 req-6ba30afb-9cf0-4b4e-aa40-ffcbfbb89d22 tempest-ServersWithSpecificFlavorTestJSON-1477718790 tempest-ServersWithSpecificFlavorTestJSON-1477718790-project-member] Enqueued Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_members [ 647.259592] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_members [ 647.259592] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.262233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.262346] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.262600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.262786] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.262898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.262962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.263183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.263272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.265020] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.397085] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: SUCCESS [ 647.397391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.399616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.399871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.400091] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.400708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.400708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.400708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.400708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.400708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.400708] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.715414] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.715651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.716313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.716313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.716313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.716313] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be created. [ 647.743301] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.743549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.743549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.744324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.744324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.758458] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: UNINITIALIZED for 2s [ 647.768387] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.768387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.768387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.768387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.768387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.768387] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.768387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.768387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.768387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.768387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.768387] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 already deleted. [ 647.768387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.907715] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.918402] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.918877] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-479" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.920271] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-479" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.920922] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-479" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.921320] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.921501] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.921620] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.921880] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.923026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.926204] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.926204] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.926204] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.926204] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.926204] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.926204] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.926204] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.952526] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.952526] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.952708] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.954420] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-479" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.954420] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-b1f7d910-7d7c-484f-b484-02c4abbc7ed0 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.954420] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-b1f7d910-7d7c-484f-b484-02c4abbc7ed0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.954420] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-b1f7d910-7d7c-484f-b484-02c4abbc7ed0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.954742] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-b1f7d910-7d7c-484f-b484-02c4abbc7ed0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.954856] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f7d910-7d7c-484f-b484-02c4abbc7ed0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.080023] env[67003]: INFO networking_nsxv3.common.synchronization [req-1c1244e0-0b7e-4b23-bccb-f136d609128f req-9166d31b-d682-494c-a0dc-7977abfecca0 tempest-ServerExternalEventsTest-588363590 tempest-ServerExternalEventsTest-588363590-project-member] Enqueued Resource ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 with Priority: HIGHEST for action security_group_members [ 648.080023] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 with Priority: HIGHEST for action security_group_members [ 648.080023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.080563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.080764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.081144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.082896] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.082896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.082896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.082896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.082896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.082896] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea05aafd-d89a-4a4a-8f6a-25194a42d3e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.337258] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c in Status: SUCCESS [ 648.337583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.413209] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7f76d7e-ac8b-403e-8138-5cfc21622e31: rpc.has_security_group_logging(os_id): False [ 648.441749] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.441929] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.442024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.442197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.442294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.442546] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.442650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.442712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.442866] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.442945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.443047] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 is going to be created. [ 648.458916] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.458916] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.458916] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.458916] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.459398] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.459398] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port b1f7d910-7d7c-484f-b484-02c4abbc7ed0 not found, creating... [ 648.459763] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.459927] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.460044] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.460339] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.460494] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.460824] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.461051] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.465031] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.465031] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.465031] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.465031] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: b1f7d910-7d7c-484f-b484-02c4abbc7ed0 is going to be created. [ 648.485406] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.485682] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.485833] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.486104] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.486491] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.486801] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-b1f7d910-7d7c-484f-b484-02c4abbc7ed0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.528584] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.528788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.528883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.529643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.529991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.542963] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: IN_PROGRESS for 2s [ 648.584761] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.585051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.585158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.585432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.585577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.585806] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.585967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.586072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.586272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.586376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.586514] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 is going to be updated. [ 648.645373] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.645649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.645649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.645896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.646063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.671624] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 in Status: IN_PROGRESS for 2s [ 649.192298] env[67003]: INFO networking_nsxv3.common.synchronization [req-add72353-5301-4add-8b41-6f830d32ef96 req-a4d2203f-3242-4412-95ff-bfd893c7fc14 service nova] Enqueued Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_rules [ 649.192298] env[67003]: INFO networking_nsxv3.common.synchronization [req-add72353-5301-4add-8b41-6f830d32ef96 req-a4d2203f-3242-4412-95ff-bfd893c7fc14 service nova] Enqueued Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_members [ 649.192298] env[67003]: INFO networking_nsxv3.common.synchronization [req-add72353-5301-4add-8b41-6f830d32ef96 req-a4d2203f-3242-4412-95ff-bfd893c7fc14 service nova] Enqueued Resource ID: b1f7d910-7d7c-484f-b484-02c4abbc7ed0 with Priority: HIGHEST for action port [ 649.192298] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_rules [ 649.192298] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_members [ 649.192298] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1f7d910-7d7c-484f-b484-02c4abbc7ed0 with Priority: HIGHEST for action port [ 649.192815] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.192815] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.192898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.193101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.193203] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.194082] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.194230] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.194269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.194437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.194581] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.194675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.194739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.194870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.194951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.195053] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.195935] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b1f7d910-7d7c-484f-b484-02c4abbc7ed0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.195935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b1f7d910-7d7c-484f-b484-02c4abbc7ed0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.196114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b1f7d910-7d7c-484f-b484-02c4abbc7ed0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.196423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b1f7d910-7d7c-484f-b484-02c4abbc7ed0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.196423] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b1f7d910-7d7c-484f-b484-02c4abbc7ed0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.698521] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.699233] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.699347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.699499] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b1f7d910-7d7c-484f-b484-02c4abbc7ed0 with status ACTIVE [ 649.699657] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.699762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.699827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.700029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.700150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.700287] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.700374] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.700438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.700589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.700666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.700842] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.700933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.700995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.701449] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.701702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.701807] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b1f7d910-7d7c-484f-b484-02c4abbc7ed0 is going to be updated. [ 649.727034] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.727034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.727034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.727034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.727347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.727347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b1f7d910-7d7c-484f-b484-02c4abbc7ed0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.772028] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 649.772400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.772537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.772677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.772902] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.773317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.773317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.773492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.773594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.773812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.773812] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.870859] env[67003]: INFO networking_nsxv3.common.synchronization [req-de1dc876-8fa2-4bf1-a9cf-7ad47132f438 req-6bb2e2c2-6cda-42c4-8ef2-8b29d646aedc tempest-AttachInterfacesV270Test-1056224786 tempest-AttachInterfacesV270Test-1056224786-project-member] Enqueued Resource ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 with Priority: HIGHEST for action security_group_members [ 649.871494] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 with Priority: HIGHEST for action security_group_members [ 649.871823] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.871947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.874188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.874502] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.877970] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.877970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.877970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.877970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.877970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.877970] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('032f92e2-50d8-4e5f-901e-8c80dbcfbdf5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.069156] env[67003]: INFO networking_nsxv3.common.synchronization [req-6052df76-137c-4db3-ba8f-8aa11be0da91 req-181d3e65-8f94-4698-a514-48fc9bcabeaf tempest-ServersTestMultiNic-1026664683 tempest-ServersTestMultiNic-1026664683-project-member] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 650.069156] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 650.069243] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.069331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.069373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.069576] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.069724] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.069821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.069881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.070167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.070333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.070552] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.205265] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.280263] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.280747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.280747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.281072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.281293] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.281438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.281533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.281671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.282488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.282595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.283503] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.283503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.283503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.283503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.283503] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.283503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.283503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.283904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.283904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.283904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.283904] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.379160] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.379592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.379592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.379791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.379945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.381202] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.381202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.381202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.381202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.381202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.381202] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 is going to be updated. [ 650.422152] env[67003]: INFO networking_nsxv3.common.synchronization [req-fad5a180-7e68-445f-a605-76dee30da067 req-f0f62fb9-c83b-42a4-95aa-27293ac39b02 tempest-VolumesAdminNegativeTest-1833608575 tempest-VolumesAdminNegativeTest-1833608575-project-member] Enqueued Resource ID: 187f2eae-7657-4240-8ccd-728badf3526c with Priority: HIGHEST for action security_group_members [ 650.422152] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f2eae-7657-4240-8ccd-728badf3526c with Priority: HIGHEST for action security_group_members [ 650.422513] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-187f2eae-7657-4240-8ccd-728badf3526c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.422655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.423858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.423858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.424770] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.424918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.424975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.425197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.425289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.425388] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('187f2eae-7657-4240-8ccd-728badf3526c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.438389] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.438389] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.438389] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.438389] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.438629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.452997] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 in Status: IN_PROGRESS for 2s [ 650.460839] env[67003]: INFO networking_nsxv3.common.synchronization [req-ba247259-92f9-440b-8ddc-6ccb5383d1dc req-43586941-bf22-4aa1-8b13-8130ed3ed630 tempest-ServersAdminTestJSON-1432619756 tempest-ServersAdminTestJSON-1432619756-project-member] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 650.461872] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 650.462310] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.462483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.462584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.462822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.463032] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.463203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.463298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.463548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.463695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.463828] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.558344] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: SUCCESS [ 650.558773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.573251] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.681987] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 in Status: SUCCESS [ 650.682326] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea05aafd-d89a-4a4a-8f6a-25194a42d3e1 deletion is rescheduled due to dependency. [ 650.682496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea05aafd-d89a-4a4a-8f6a-25194a42d3e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.707768] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.708174] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.708174] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.708289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.708444] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.708533] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 is going to be created. [ 650.741378] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.741378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.741575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.741728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.741825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.748441] env[67003]: INFO networking_nsxv3.common.synchronization [req-6052df76-137c-4db3-ba8f-8aa11be0da91 req-daf1f425-7c47-4d2d-8b51-f464db3274f8 tempest-ServersTestMultiNic-1026664683 tempest-ServersTestMultiNic-1026664683-project-member] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 650.749199] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 650.749871] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.749871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.758695] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24c47389-894a-46a4-ac4e-16c5bd995856 in Status: UNINITIALIZED for 2s [ 650.786639] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a47e002a-325f-4303-8dea-86209028ebb0: rpc.has_security_group_logging(os_id): False [ 650.825076] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.825076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.825076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.825076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.825721] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.825721] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.825721] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.825721] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.825887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.825887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.826674] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.826674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.826674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.826674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.826891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.826934] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.827139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.827139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.827531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.827636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.827727] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be created. [ 650.915783] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.916012] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.916012] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.916281] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.916430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.930329] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 650.933648] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.933648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.933648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.934034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.934034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.934136] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.934235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.934456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.934593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.934593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.934868] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f2eae-7657-4240-8ccd-728badf3526c is going to be updated. [ 650.968636] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.983410] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.983641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.983641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.983875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.985362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.999961] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f2eae-7657-4240-8ccd-728badf3526c in Status: IN_PROGRESS for 2s [ 651.075892] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.207078] env[67003]: INFO networking_nsxv3.common.synchronization [req-6052df76-137c-4db3-ba8f-8aa11be0da91 req-9f604b3c-bdcb-40f3-ae26-d8b2104ba5fe tempest-ServersTestMultiNic-1026664683 tempest-ServersTestMultiNic-1026664683-project-member] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 651.207469] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 651.207980] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.208123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.264118] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-329 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.264367] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.264450] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.264743] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.265108] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.265330] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.265451] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.265786] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.267320] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.267320] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.267320] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 651.267320] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 651.267320] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 651.267320] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 651.267320] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 651.267320] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 651.287234] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 651.287933] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 651.287933] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 651.287933] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.288224] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-7d20e052-ebe3-468d-b474-117c5f6ba608 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.288224] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-7d20e052-ebe3-468d-b474-117c5f6ba608" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.288398] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-7d20e052-ebe3-468d-b474-117c5f6ba608" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.289036] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-7d20e052-ebe3-468d-b474-117c5f6ba608" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.289036] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d20e052-ebe3-468d-b474-117c5f6ba608',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.469816] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.580238] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.580329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.580397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.580614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.580734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.580837] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 651.612553] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.612999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.612999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.612999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.613244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.622945] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 651.792125] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.792429] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.792492] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.792788] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.792940] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.793127] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 7d20e052-ebe3-468d-b474-117c5f6ba608 not found, creating... [ 651.793477] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.793645] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.793759] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.793995] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.794249] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.794563] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.794718] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.794831] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.795142] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.795300] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.795445] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 7d20e052-ebe3-468d-b474-117c5f6ba608 is going to be created. [ 651.819879] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.820111] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.820234] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.820504] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.820748] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.820932] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-7d20e052-ebe3-468d-b474-117c5f6ba608" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.972996] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.973209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.973318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.973515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.973612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.973747] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 652.014717] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.014915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.015049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.015390] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.015600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.025849] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 652.463950] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 in Status: SUCCESS [ 652.464233] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 deletion is rescheduled due to dependency. [ 652.464433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.604333] env[67003]: INFO networking_nsxv3.common.synchronization [req-ba247259-92f9-440b-8ddc-6ccb5383d1dc req-c3fbfa66-0436-4e09-bc45-6fd7cd538588 service nova] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_rules [ 652.604504] env[67003]: INFO networking_nsxv3.common.synchronization [req-ba247259-92f9-440b-8ddc-6ccb5383d1dc req-c3fbfa66-0436-4e09-bc45-6fd7cd538588 service nova] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 652.604699] env[67003]: INFO networking_nsxv3.common.synchronization [req-ba247259-92f9-440b-8ddc-6ccb5383d1dc req-c3fbfa66-0436-4e09-bc45-6fd7cd538588 service nova] Enqueued Resource ID: 7d20e052-ebe3-468d-b474-117c5f6ba608 with Priority: HIGHEST for action port [ 652.605277] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_rules [ 652.605439] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 652.605564] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d20e052-ebe3-468d-b474-117c5f6ba608 with Priority: HIGHEST for action port [ 652.606060] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.606461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.606552] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.606670] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.606925] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d20e052-ebe3-468d-b474-117c5f6ba608 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.607047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d20e052-ebe3-468d-b474-117c5f6ba608" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.607143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d20e052-ebe3-468d-b474-117c5f6ba608" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.607422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d20e052-ebe3-468d-b474-117c5f6ba608" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.607541] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d20e052-ebe3-468d-b474-117c5f6ba608',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.784121] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24c47389-894a-46a4-ac4e-16c5bd995856 in Status: SUCCESS [ 652.784121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.784121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.785828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.785828] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.786317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.786317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.786317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.786317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.786494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.786494] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.942809] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 652.943098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.943253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.943478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.943567] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.009381] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 187f2eae-7657-4240-8ccd-728badf3526c in Status: SUCCESS [ 653.009592] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 187f2eae-7657-4240-8ccd-728badf3526c deletion is rescheduled due to dependency. [ 653.009711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.112133] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7d20e052-ebe3-468d-b474-117c5f6ba608 with status ACTIVE [ 653.112133] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.112133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.112133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.112423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.112423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.112610] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.112744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.112795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.114778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.114778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.114778] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.114778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.114778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.114778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.114778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.114778] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7d20e052-ebe3-468d-b474-117c5f6ba608 is going to be updated. [ 653.145628] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.145783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.145783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.146075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.146216] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.146390] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d20e052-ebe3-468d-b474-117c5f6ba608" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.298624] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.356189] env[67003]: INFO networking_nsxv3.common.synchronization [None req-b913f5be-529d-437c-9252-4a2c8d4a64e5 None None] Enqueued Resource ID: d23cfd50-87b7-48ac-9c5d-fadc3dc4dd22 with Priority: HIGHEST for action port [ 653.356189] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d23cfd50-87b7-48ac-9c5d-fadc3dc4dd22 with Priority: HIGHEST for action port [ 653.356648] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d23cfd50-87b7-48ac-9c5d-fadc3dc4dd22 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.356648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d23cfd50-87b7-48ac-9c5d-fadc3dc4dd22" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.356774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d23cfd50-87b7-48ac-9c5d-fadc3dc4dd22" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.356991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d23cfd50-87b7-48ac-9c5d-fadc3dc4dd22" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.357172] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d23cfd50-87b7-48ac-9c5d-fadc3dc4dd22',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.361407] env[67003]: INFO networking_nsxv3.common.synchronization [req-f654f34a-5411-4190-91b3-ea156781f987 req-b8a0d2fb-7e33-4d2a-a298-2e8fdc0498d1 tempest-DeleteServersAdminTestJSON-1035837237 tempest-DeleteServersAdminTestJSON-1035837237-project-member] Enqueued Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_members [ 653.362264] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_members [ 653.364536] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.364536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.364536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.364536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.364536] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.364536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.364536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.364536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.364536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.364536] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.445888] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.446071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.634814] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 653.634814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.634814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.635082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.635204] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.635291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.635406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.635490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.635566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.635713] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.803710] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24c47389-894a-46a4-ac4e-16c5bd995856: rpc.has_security_group_logging(os_id): False [ 653.822192] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.822192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.822192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.822192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.822192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.822192] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.822192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.822192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.822192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.822192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.822618] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 is going to be created. [ 653.862491] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d23cfd50-87b7-48ac-9c5d-fadc3dc4dd22 [ 653.862747] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.862972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.862972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.863223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.863360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.863467] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d23cfd50-87b7-48ac-9c5d-fadc3dc4dd22 already deleted. [ 653.863683] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d23cfd50-87b7-48ac-9c5d-fadc3dc4dd22" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.868168] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.868329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.868812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.868812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.868812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.868812] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.868972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.868972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.869818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.869818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.869818] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 is going to be updated. [ 653.885904] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.886093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.886144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.886344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.886544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.897326] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24c47389-894a-46a4-ac4e-16c5bd995856 in Status: IN_PROGRESS for 2s [ 653.898832] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.899235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.899235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.899392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.899533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.907823] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: IN_PROGRESS for 2s [ 654.001808] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.002150] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.004585] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.004585] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.004585] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.004585] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.004585] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.004585] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.004585] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.004585] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.004585] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 654.004585] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 654.004585] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 654.004585] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 654.005115] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 654.005115] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 654.023537] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 654.023729] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 654.023881] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 654.024099] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.024460] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-b832a8c5-c73f-403e-ba1a-1ebfce0ae748 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.024637] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-b832a8c5-c73f-403e-ba1a-1ebfce0ae748" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.024758] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-b832a8c5-c73f-403e-ba1a-1ebfce0ae748" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.025103] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-b832a8c5-c73f-403e-ba1a-1ebfce0ae748" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.025276] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b832a8c5-c73f-403e-ba1a-1ebfce0ae748',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.034675] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 654.034784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.034938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.035215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.035381] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.035501] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.035577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.036289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.036289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.036289] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.138420] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.138563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.138654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.138851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.138952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.139170] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.139323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.139454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.139600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.139973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.139973] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 654.174655] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.174843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.174884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.176039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.176039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.186887] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 654.529125] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.529533] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.529533] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.529800] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.529958] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.530119] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port b832a8c5-c73f-403e-ba1a-1ebfce0ae748 not found, creating... [ 654.530453] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.530774] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.530897] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.531161] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.531307] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.531592] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.531745] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.531859] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.532094] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.532294] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.532468] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: b832a8c5-c73f-403e-ba1a-1ebfce0ae748 is going to be created. [ 654.538728] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.553437] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.558710] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.558710] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.558911] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.559089] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.559373] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-b832a8c5-c73f-403e-ba1a-1ebfce0ae748" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.041494] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.322263] env[67003]: INFO networking_nsxv3.common.synchronization [req-f654f34a-5411-4190-91b3-ea156781f987 req-c7cb27b5-01cc-47a0-ad27-66a3807412c8 service nova] Enqueued Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_rules [ 655.322439] env[67003]: INFO networking_nsxv3.common.synchronization [req-f654f34a-5411-4190-91b3-ea156781f987 req-c7cb27b5-01cc-47a0-ad27-66a3807412c8 service nova] Enqueued Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_members [ 655.322573] env[67003]: INFO networking_nsxv3.common.synchronization [req-f654f34a-5411-4190-91b3-ea156781f987 req-c7cb27b5-01cc-47a0-ad27-66a3807412c8 service nova] Enqueued Resource ID: b832a8c5-c73f-403e-ba1a-1ebfce0ae748 with Priority: HIGHEST for action port [ 655.323660] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_rules [ 655.323660] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_members [ 655.323660] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b832a8c5-c73f-403e-ba1a-1ebfce0ae748 with Priority: HIGHEST for action port [ 655.324475] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.324685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.324761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.324989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.325307] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.328292] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.328292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.328292] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b832a8c5-c73f-403e-ba1a-1ebfce0ae748 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.328292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b832a8c5-c73f-403e-ba1a-1ebfce0ae748" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.328292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b832a8c5-c73f-403e-ba1a-1ebfce0ae748" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.328292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b832a8c5-c73f-403e-ba1a-1ebfce0ae748" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.328292] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b832a8c5-c73f-403e-ba1a-1ebfce0ae748',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.450871] env[67003]: INFO networking_nsxv3.common.synchronization [None req-6afb5271-930a-401b-b86c-1e1171500d9c None None] Enqueued Resource ID: ed3aeed6-8993-4cc7-baf3-e82932afd0e9 with Priority: HIGHEST for action port [ 655.453235] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ed3aeed6-8993-4cc7-baf3-e82932afd0e9 with Priority: HIGHEST for action port [ 655.454887] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-ed3aeed6-8993-4cc7-baf3-e82932afd0e9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.454887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ed3aeed6-8993-4cc7-baf3-e82932afd0e9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.454887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ed3aeed6-8993-4cc7-baf3-e82932afd0e9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.454887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ed3aeed6-8993-4cc7-baf3-e82932afd0e9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.454887] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ed3aeed6-8993-4cc7-baf3-e82932afd0e9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.545293] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.545293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.545293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.545293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.545293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.545293] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 655.574229] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.574468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.574468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.576111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.576111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.591884] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 655.829774] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.829774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.829774] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b832a8c5-c73f-403e-ba1a-1ebfce0ae748 with status ACTIVE [ 655.829774] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.829774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.829774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.831461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.831461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.831461] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.831461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.831461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.831461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.831461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.832967] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.833391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.833391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.833566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.833566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.833686] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b832a8c5-c73f-403e-ba1a-1ebfce0ae748 is going to be updated. [ 655.862282] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.862491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.862588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.862831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.863159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.863269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b832a8c5-c73f-403e-ba1a-1ebfce0ae748" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.913071] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24c47389-894a-46a4-ac4e-16c5bd995856 in Status: SUCCESS [ 655.913251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.919345] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: SUCCESS [ 655.919414] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 deletion is rescheduled due to dependency. [ 655.919535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.919712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.920184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.920184] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.920338] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.920338] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.920466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.920543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.920640] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.956085] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ed3aeed6-8993-4cc7-baf3-e82932afd0e9 [ 655.956450] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.956450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.956730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.956730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.956843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.956911] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ed3aeed6-8993-4cc7-baf3-e82932afd0e9 already deleted. [ 655.956975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ed3aeed6-8993-4cc7-baf3-e82932afd0e9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.199362] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 656.204021] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 deletion is rescheduled due to dependency. [ 656.204021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.204021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.204021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.204021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.204021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.204021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.204021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.204021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.204021] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.424661] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.555961] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e326702b-8b6e-451d-8b1a-077313dcfede None None] Enqueued Resource ID: 56e2fee1-5cf7-4d5b-b62f-686b41f8545e with Priority: HIGHEST for action port [ 656.556663] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56e2fee1-5cf7-4d5b-b62f-686b41f8545e with Priority: HIGHEST for action port [ 656.557173] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-56e2fee1-5cf7-4d5b-b62f-686b41f8545e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.560226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56e2fee1-5cf7-4d5b-b62f-686b41f8545e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.560340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56e2fee1-5cf7-4d5b-b62f-686b41f8545e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.560782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56e2fee1-5cf7-4d5b-b62f-686b41f8545e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.560782] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56e2fee1-5cf7-4d5b-b62f-686b41f8545e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.711882] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.711882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.711882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.711882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.711882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.712157] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.713322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.713322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.713322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.713322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.713322] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 656.747231] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.748109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.748203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.748431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.749016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.768984] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 656.928366] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.064327] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 56e2fee1-5cf7-4d5b-b62f-686b41f8545e [ 657.064618] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.064759] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.064830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.065076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.065172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.065267] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:56e2fee1-5cf7-4d5b-b62f-686b41f8545e already deleted. [ 657.065349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56e2fee1-5cf7-4d5b-b62f-686b41f8545e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.434527] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.434943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.434943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.435032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.435085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.435183] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 is going to be updated. [ 657.468412] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.468675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.470445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.470445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.470445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.484502] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: IN_PROGRESS for 2s [ 657.605028] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 657.605028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.605028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.605028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.605028] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.605028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.605028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.605028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.605028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.605028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.605028] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.107765] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.108051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.108201] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.108293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.108698] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.108698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.108698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.109482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.109482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.109482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.109482] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.109482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.109482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.109766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.109766] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.109867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.109920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.110044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.110118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.110182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.110280] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.118113] env[67003]: INFO networking_nsxv3.common.synchronization [None req-233b2e12-dc59-4827-9d97-61712f2fb691 None None] Enqueued Resource ID: b89d0eb5-fcd6-40ec-8e6b-a4af43ae81c2 with Priority: HIGHEST for action port [ 658.118799] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b89d0eb5-fcd6-40ec-8e6b-a4af43ae81c2 with Priority: HIGHEST for action port [ 658.119798] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b89d0eb5-fcd6-40ec-8e6b-a4af43ae81c2 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.120018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b89d0eb5-fcd6-40ec-8e6b-a4af43ae81c2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.120101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b89d0eb5-fcd6-40ec-8e6b-a4af43ae81c2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.120367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b89d0eb5-fcd6-40ec-8e6b-a4af43ae81c2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.120465] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b89d0eb5-fcd6-40ec-8e6b-a4af43ae81c2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.520490] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e0ef52db-799d-435a-9ac8-db75c7116bf2 tempest-ServersV294TestFqdnHostnames-1804776967 tempest-ServersV294TestFqdnHostnames-1804776967-project-member] Enqueued Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGHEST for action security_group_rules [ 658.520843] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGHEST for action security_group_rules [ 658.520843] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0984692d-32cd-4b7f-9bd0-7496ca581278 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.520967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.521266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.521340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.521416] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.619587] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a47e002a-325f-4303-8dea-86209028ebb0: rpc.has_security_group_logging(os_id): False [ 658.623463] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b89d0eb5-fcd6-40ec-8e6b-a4af43ae81c2 [ 658.623729] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.623903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.624021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.624252] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.624356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.624471] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b89d0eb5-fcd6-40ec-8e6b-a4af43ae81c2 already deleted. [ 658.624536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b89d0eb5-fcd6-40ec-8e6b-a4af43ae81c2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.639977] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.640637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.640637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.640724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.640805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.641472] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.641472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.641472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.641689] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.642021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.642128] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.642295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.642458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.642625] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.642750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.643067] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.643340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.643340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.643562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.643699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.643842] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 658.708729] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.708954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.708954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.709158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.709313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.726407] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 658.799683] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 658.799837] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 deletion is rescheduled due to dependency. [ 658.800763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.893024] env[67003]: INFO networking_nsxv3.common.synchronization [None req-f31aba02-ace2-4934-9a3b-4f4823119474 tempest-ServersV294TestFqdnHostnames-1804776967 tempest-ServersV294TestFqdnHostnames-1804776967-project-member] Enqueued Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGHEST for action security_group_rules [ 658.893024] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGHEST for action security_group_rules [ 658.893024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0984692d-32cd-4b7f-9bd0-7496ca581278 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.894068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.932739] env[67003]: INFO networking_nsxv3.common.synchronization [req-0ac97196-9ef5-4310-8c13-ade2e8afa6cc req-6d174553-023b-44f5-9ad4-bc80e77741b0 tempest-FloatingIPsAssociationTestJSON-1536953296 tempest-FloatingIPsAssociationTestJSON-1536953296-project-member] Enqueued Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_members [ 658.933300] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_members [ 658.933663] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.934196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.934196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.934463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.934651] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.934762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.934828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.934981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.935091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.935200] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.043168] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.043423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.043480] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.043684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.043777] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.043868] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 already deleted. [ 659.043951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.044116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.044270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.044346] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.437834] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.438093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.438093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.438374] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.438475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.438933] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.438933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.438933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.439215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.439215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.439215] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d already deleted. [ 659.439356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.497158] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: SUCCESS [ 659.497411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.497620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.497893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.498124] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.498260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.498336] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.498496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.498592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.498683] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.498775] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.569120] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.569120] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.569120] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.569694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.569694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.569694] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 already deleted. [ 659.569694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.593074] env[67003]: INFO networking_nsxv3.common.synchronization [req-abd50bee-d06d-4cd9-b4f3-02806b197b72 req-b0bd8a33-eed8-4ea1-b9f7-86640d069e0b tempest-ServerAddressesNegativeTestJSON-298726464 tempest-ServerAddressesNegativeTestJSON-298726464-project-member] Enqueued Resource ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 with Priority: HIGHEST for action security_group_members [ 659.593602] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 with Priority: HIGHEST for action security_group_members [ 659.593994] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-096a4cda-6a5e-4383-92c4-166cabe87e96 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.594434] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.594515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.594727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.594903] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.595033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.595082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.595235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.595319] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.595412] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('096a4cda-6a5e-4383-92c4-166cabe87e96',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.921279] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.921504] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-389" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.921629] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-389" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.921952] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-389" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.922233] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.922393] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.922509] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.922724] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.922863] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.923077] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.923403] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 659.923403] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 659.923540] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 659.923540] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 659.924250] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 659.924250] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 659.943545] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 659.943663] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 659.943964] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 659.944215] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-389" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.944932] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-01021402-0643-4654-a9ab-577f89be4aee taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.945170] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-01021402-0643-4654-a9ab-577f89be4aee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.945322] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-01021402-0643-4654-a9ab-577f89be4aee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.945654] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-01021402-0643-4654-a9ab-577f89be4aee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.945827] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01021402-0643-4654-a9ab-577f89be4aee',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.003508] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.003508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.003769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.003769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.003946] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.004060] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.004126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.004298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.004393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.004483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.004632] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.004727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.004789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.004931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.005079] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.005171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.005232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.005383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.005461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.005541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.005631] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.097684] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.097972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.098416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.098416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.098534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.098748] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.098951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.099062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.099252] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.099337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.099452] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 is going to be updated. [ 660.142688] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.142688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.142688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.145809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.145809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.154939] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 in Status: IN_PROGRESS for 2s [ 660.448602] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.448840] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.448964] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.449266] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.449429] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.449577] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 01021402-0643-4654-a9ab-577f89be4aee not found, creating... [ 660.449872] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.450309] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.450309] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.450474] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.450651] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.450987] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.451122] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.451341] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.451479] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.452750] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.452750] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 01021402-0643-4654-a9ab-577f89be4aee is going to be created. [ 660.475833] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.476101] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.476234] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.476506] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.476970] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.477105] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-01021402-0643-4654-a9ab-577f89be4aee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.508725] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8411bfa0-87b0-49a2-a1eb-a535d9d88274: rpc.has_security_group_logging(os_id): False [ 660.528061] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.528253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.528379] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.528507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.528603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.528819] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.528992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.528992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.529138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.529236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.529397] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.529533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.529595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.529689] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.529764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.529943] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.530095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.530160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.530285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.530377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.530441] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 is going to be updated. [ 660.628221] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.628704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.628704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.628704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.628951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.647492] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: IN_PROGRESS for 2s [ 660.769340] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 660.769964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.202471] env[67003]: INFO networking_nsxv3.common.synchronization [req-0ac97196-9ef5-4310-8c13-ade2e8afa6cc req-9fdafc93-c3e8-4aff-a9d0-9dbe54f3ea6a service nova] Enqueued Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_rules [ 661.202471] env[67003]: INFO networking_nsxv3.common.synchronization [req-0ac97196-9ef5-4310-8c13-ade2e8afa6cc req-9fdafc93-c3e8-4aff-a9d0-9dbe54f3ea6a service nova] Enqueued Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_members [ 661.203186] env[67003]: INFO networking_nsxv3.common.synchronization [req-0ac97196-9ef5-4310-8c13-ade2e8afa6cc req-9fdafc93-c3e8-4aff-a9d0-9dbe54f3ea6a service nova] Enqueued Resource ID: 01021402-0643-4654-a9ab-577f89be4aee with Priority: HIGHEST for action port [ 661.208199] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_rules [ 661.208558] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_members [ 661.208558] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01021402-0643-4654-a9ab-577f89be4aee with Priority: HIGHEST for action port [ 661.208726] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.210027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.210027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.210027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.210027] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.210289] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.210289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.210382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.210480] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.210644] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.210717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.210762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.210897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.210977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.211195] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.211861] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-01021402-0643-4654-a9ab-577f89be4aee taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.212277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01021402-0643-4654-a9ab-577f89be4aee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.212277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01021402-0643-4654-a9ab-577f89be4aee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.212277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01021402-0643-4654-a9ab-577f89be4aee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.212277] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01021402-0643-4654-a9ab-577f89be4aee',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.638041] env[67003]: INFO networking_nsxv3.common.synchronization [req-530c0a0f-ac63-4b73-a7ea-40e474ae5dfd req-ee70a344-df4c-48a2-9738-379ca5790012 tempest-ServerPasswordTestJSON-448684487 tempest-ServerPasswordTestJSON-448684487-project-member] Enqueued Resource ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 with Priority: HIGHEST for action security_group_members [ 661.638638] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 with Priority: HIGHEST for action security_group_members [ 661.639760] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ec7c3eec-28bb-4dcc-a740-eca86fce2578 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.639760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.639760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.639760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.639760] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.639760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.640193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.640193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.640193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.640193] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ec7c3eec-28bb-4dcc-a740-eca86fce2578',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.713663] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.714829] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.715042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.715266] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01021402-0643-4654-a9ab-577f89be4aee with status ACTIVE [ 661.715553] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.715553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.715720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.715849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.715911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.716121] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.716213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.716328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.716616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.716616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.716819] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.716948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.717194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.717357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.717453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.717540] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01021402-0643-4654-a9ab-577f89be4aee is going to be updated. [ 661.741090] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.741245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.741424] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.741692] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.741869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.742080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01021402-0643-4654-a9ab-577f89be4aee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.142193] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.142421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.142421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.143246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.143246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.143246] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.143246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.143468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.143504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.143580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.143895] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 is going to be updated. [ 662.166065] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 in Status: SUCCESS [ 662.166156] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 deletion is rescheduled due to dependency. [ 662.168019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.177821] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.178142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.178142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.179215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.179215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.190332] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 in Status: IN_PROGRESS for 2s [ 662.220218] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.349270] env[67003]: INFO networking_nsxv3.common.synchronization [None req-8d51e53e-0848-43fb-b0a3-27b12c0260c5 None None] Enqueued Resource ID: f30b0282-d795-471d-92f1-09504ffef95b with Priority: HIGHEST for action port [ 662.349658] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f30b0282-d795-471d-92f1-09504ffef95b with Priority: HIGHEST for action port [ 662.350100] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-f30b0282-d795-471d-92f1-09504ffef95b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.350198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f30b0282-d795-471d-92f1-09504ffef95b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.350268] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f30b0282-d795-471d-92f1-09504ffef95b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.350545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f30b0282-d795-471d-92f1-09504ffef95b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.350639] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f30b0282-d795-471d-92f1-09504ffef95b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.500695] env[67003]: INFO networking_nsxv3.common.synchronization [req-764b79c3-5cb5-4679-a8e5-f42e7ecae4c6 req-bdf05ed6-355f-4d85-b27c-e53ffff3d02b tempest-MigrationsAdminTest-779889772 tempest-MigrationsAdminTest-779889772-project-member] Enqueued Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_members [ 662.501605] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_members [ 662.502635] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.502796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.502912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.503084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.504525] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.504525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.504525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.504525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.504525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.504525] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.665359] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: SUCCESS [ 662.665359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.724867] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.724867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.725223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.725223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.725881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.725881] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d is going to be created. [ 662.780194] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.780194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.780194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.780194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.780194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.793917] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: UNINITIALIZED for 2s [ 662.854033] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f30b0282-d795-471d-92f1-09504ffef95b [ 662.854033] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.854033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.854033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.854033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.854033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.854033] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f30b0282-d795-471d-92f1-09504ffef95b already deleted. [ 662.854033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f30b0282-d795-471d-92f1-09504ffef95b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.007537] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.007698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.007773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.007991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.008108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.008310] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.008448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.008484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.008629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.008744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.008782] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b already deleted. [ 663.008857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.107583] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.107784] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.107919] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.108183] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.108435] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.108588] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.108699] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.108912] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.109534] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.109805] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.112107] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 663.113113] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 663.113113] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 663.113113] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 663.113113] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 663.113113] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 663.131499] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 663.131679] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 663.131816] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 663.131986] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.132315] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-6e566de4-99aa-4f9a-b98e-5d3b60a491b5 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.132488] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-6e566de4-99aa-4f9a-b98e-5d3b60a491b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.132607] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-6e566de4-99aa-4f9a-b98e-5d3b60a491b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.132924] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-6e566de4-99aa-4f9a-b98e-5d3b60a491b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.133597] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e566de4-99aa-4f9a-b98e-5d3b60a491b5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.638755] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.639061] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.639307] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.639606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.640356] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.640356] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 6e566de4-99aa-4f9a-b98e-5d3b60a491b5 not found, creating... [ 663.640356] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.641127] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.641127] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.641127] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.641127] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.642276] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.642276] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.642276] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.642276] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.642509] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.642620] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 6e566de4-99aa-4f9a-b98e-5d3b60a491b5 is going to be created. [ 663.829247] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.829247] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.829247] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.829717] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.829717] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.829973] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-6e566de4-99aa-4f9a-b98e-5d3b60a491b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.884018] env[67003]: INFO networking_nsxv3.common.synchronization [None req-2b0e7c89-f6a4-4bc7-a124-0685d22b9373 None None] Enqueued Resource ID: c0268672-eee4-45c3-85cc-983e32279d59 with Priority: HIGHEST for action port [ 663.884830] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0268672-eee4-45c3-85cc-983e32279d59 with Priority: HIGHEST for action port [ 663.884920] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0268672-eee4-45c3-85cc-983e32279d59 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.885788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0268672-eee4-45c3-85cc-983e32279d59" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.885788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0268672-eee4-45c3-85cc-983e32279d59" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.885788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0268672-eee4-45c3-85cc-983e32279d59" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.885788] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0268672-eee4-45c3-85cc-983e32279d59',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.201576] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 in Status: SUCCESS [ 664.201743] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 deletion is rescheduled due to dependency. [ 664.201857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.388524] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0268672-eee4-45c3-85cc-983e32279d59 [ 664.388845] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.388915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.388915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.389191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.389271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.389332] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0268672-eee4-45c3-85cc-983e32279d59 already deleted. [ 664.389415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0268672-eee4-45c3-85cc-983e32279d59" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.393640] env[67003]: INFO networking_nsxv3.common.synchronization [req-764b79c3-5cb5-4679-a8e5-f42e7ecae4c6 req-a5647e55-8ae5-40d5-b8ef-f26e41a2abfc service nova] Enqueued Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_rules [ 664.393799] env[67003]: INFO networking_nsxv3.common.synchronization [req-764b79c3-5cb5-4679-a8e5-f42e7ecae4c6 req-a5647e55-8ae5-40d5-b8ef-f26e41a2abfc service nova] Enqueued Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_members [ 664.393929] env[67003]: INFO networking_nsxv3.common.synchronization [req-764b79c3-5cb5-4679-a8e5-f42e7ecae4c6 req-a5647e55-8ae5-40d5-b8ef-f26e41a2abfc service nova] Enqueued Resource ID: 6e566de4-99aa-4f9a-b98e-5d3b60a491b5 with Priority: HIGHEST for action port [ 664.394546] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_rules [ 664.394855] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_members [ 664.394855] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e566de4-99aa-4f9a-b98e-5d3b60a491b5 with Priority: HIGHEST for action port [ 664.395916] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.395916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.395916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.396173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.396256] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.398901] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.398901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.398901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.398901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.398901] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.398901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.398901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.398901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.398901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.398901] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.399280] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e566de4-99aa-4f9a-b98e-5d3b60a491b5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.399280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e566de4-99aa-4f9a-b98e-5d3b60a491b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.399371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e566de4-99aa-4f9a-b98e-5d3b60a491b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.399787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e566de4-99aa-4f9a-b98e-5d3b60a491b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.399787] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e566de4-99aa-4f9a-b98e-5d3b60a491b5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.804723] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: SUCCESS [ 664.804974] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.805179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.805398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.805585] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.805743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.805827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.805987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.806079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.806162] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.806253] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.903453] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.904698] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.904698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.904919] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6e566de4-99aa-4f9a-b98e-5d3b60a491b5 with status ACTIVE [ 664.904919] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.905028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.905531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.905531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.905531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.905531] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.906356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.906356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.906356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.906356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.909181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.909181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.909181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.909422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.909422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.909489] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6e566de4-99aa-4f9a-b98e-5d3b60a491b5 is going to be updated. [ 664.940655] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.940655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.940655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.940655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.940655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.940869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e566de4-99aa-4f9a-b98e-5d3b60a491b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.967566] env[67003]: INFO networking_nsxv3.common.synchronization [None req-d2e72640-bb0c-41d9-9852-c9150171d9b3 None None] Enqueued Resource ID: 04d31d3a-74c4-4b80-9b11-6bc0ec9a8869 with Priority: HIGHEST for action port [ 664.968304] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d31d3a-74c4-4b80-9b11-6bc0ec9a8869 with Priority: HIGHEST for action port [ 664.969976] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-04d31d3a-74c4-4b80-9b11-6bc0ec9a8869 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.969976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04d31d3a-74c4-4b80-9b11-6bc0ec9a8869" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.969976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04d31d3a-74c4-4b80-9b11-6bc0ec9a8869" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.970149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04d31d3a-74c4-4b80-9b11-6bc0ec9a8869" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.970184] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04d31d3a-74c4-4b80-9b11-6bc0ec9a8869',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.312337] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.312337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.312337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.312337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.312576] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.312636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.312704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.312859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.312939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.313044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.313191] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.313280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.313450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.313606] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.313744] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.313831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.313888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.314036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.314111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.314189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.314373] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.412711] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.473990] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04d31d3a-74c4-4b80-9b11-6bc0ec9a8869 [ 665.474248] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.474422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.474509] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.474731] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.474822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.474923] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04d31d3a-74c4-4b80-9b11-6bc0ec9a8869 already deleted. [ 665.475014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04d31d3a-74c4-4b80-9b11-6bc0ec9a8869" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.816673] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e316a4c0-3a83-4827-a5c7-8cc4a342b65d: rpc.has_security_group_logging(os_id): False [ 665.837210] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.837355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.837410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.838654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.838654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.838654] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.838654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.838654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.838654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.838654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.838654] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.838654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.838654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.840186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.840186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.841756] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.841987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.842080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.842322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.842887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.842887] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d is going to be created. [ 665.915446] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.915969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.915969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.915969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.915969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.916120] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b is going to be created. [ 665.927114] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.930036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.930036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.930036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.930036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.944654] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: IN_PROGRESS for 2s [ 665.954079] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.954079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.954079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.954079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.954079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.962522] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: UNINITIALIZED for 2s [ 666.246766] env[67003]: INFO networking_nsxv3.common.synchronization [None req-cff0818d-87df-45ee-8ca0-8d5e0acdbaa1 None None] Enqueued Resource ID: 0813f382-173f-4cae-987a-616904ca1c6d with Priority: HIGHEST for action port [ 666.247364] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0813f382-173f-4cae-987a-616904ca1c6d with Priority: HIGHEST for action port [ 666.247690] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0813f382-173f-4cae-987a-616904ca1c6d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.247810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0813f382-173f-4cae-987a-616904ca1c6d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.247887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0813f382-173f-4cae-987a-616904ca1c6d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.248298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0813f382-173f-4cae-987a-616904ca1c6d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.248387] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0813f382-173f-4cae-987a-616904ca1c6d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 666.753796] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0813f382-173f-4cae-987a-616904ca1c6d [ 666.753796] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 666.753796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 666.753796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 666.753796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 666.753796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 666.753796] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0813f382-173f-4cae-987a-616904ca1c6d already deleted. [ 666.753796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0813f382-173f-4cae-987a-616904ca1c6d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.963874] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: SUCCESS [ 667.963874] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.972506] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: SUCCESS [ 667.972686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.973093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.973420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.973698] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.974092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.974092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.975101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.975101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.975101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.975101] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.478075] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.478156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.478284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.478560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.478708] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.478777] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.478849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.479015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.479115] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.479205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.479725] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.479725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.479725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.479725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.479936] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.479936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.479936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.480072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.480996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.480996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.480996] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.983394] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d622b8c0-157c-4b92-b9e3-c2d6c4c2793b: rpc.has_security_group_logging(os_id): False [ 669.004397] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.004397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.004397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.004792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.004838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.005154] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.005331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.005536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.005619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.005678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.006112] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.006246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.006324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.006744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.006744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.006899] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.007209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.007209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.008134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.008134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.008134] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b is going to be created. [ 669.077036] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.077356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.079019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.079019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.079019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.093181] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: IN_PROGRESS for 2s [ 671.106410] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: SUCCESS [ 671.107218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.248060] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 671.248060] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 672.746109] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ae2be4d5-c352-4128-b854-ff93137a33ca None None] Enqueued Resource ID: df69d100-3a2d-4d82-bf6e-07ec4963a43c with Priority: HIGHEST for action port [ 672.746642] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df69d100-3a2d-4d82-bf6e-07ec4963a43c with Priority: HIGHEST for action port [ 672.746941] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-df69d100-3a2d-4d82-bf6e-07ec4963a43c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.747305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df69d100-3a2d-4d82-bf6e-07ec4963a43c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.747391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df69d100-3a2d-4d82-bf6e-07ec4963a43c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.749164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df69d100-3a2d-4d82-bf6e-07ec4963a43c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.749257] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df69d100-3a2d-4d82-bf6e-07ec4963a43c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.252659] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df69d100-3a2d-4d82-bf6e-07ec4963a43c [ 673.252999] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.252999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.252999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.253217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.253330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.253451] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df69d100-3a2d-4d82-bf6e-07ec4963a43c already deleted. [ 673.253451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df69d100-3a2d-4d82-bf6e-07ec4963a43c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.502076] env[67003]: INFO networking_nsxv3.common.synchronization [req-64030160-0b32-4636-a7b8-283a56ff26ed req-88d9124c-5d2d-4be4-bf2b-2a22d73898a6 tempest-InstanceActionsNegativeTestJSON-699013072 tempest-InstanceActionsNegativeTestJSON-699013072-project-member] Enqueued Resource ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e with Priority: HIGHEST for action security_group_members [ 673.502654] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e with Priority: HIGHEST for action security_group_members [ 673.502966] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.503774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.503867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.505648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.505843] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.505956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.506039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.506211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.506296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.506391] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa8a0a38-37aa-4674-acd4-bfc56f11a31e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.012181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.012181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.012181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.012181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.012181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.012181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.012181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.012181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.012181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.012181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.012181] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e already deleted. [ 674.012181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.155536] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-244 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.155668] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-244" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.155879] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-244" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.156209] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-244" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.156462] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.156615] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.156723] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.156932] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.157538] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.157862] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.157945] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 674.157987] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 674.158096] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 674.158197] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 674.158298] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 674.158425] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 674.184143] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 674.184143] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 674.184333] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 674.184545] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-244" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.184966] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-36f088fb-a7ea-4848-a827-4ee21012ca50 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.185196] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-36f088fb-a7ea-4848-a827-4ee21012ca50" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.185335] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-36f088fb-a7ea-4848-a827-4ee21012ca50" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.185776] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-36f088fb-a7ea-4848-a827-4ee21012ca50" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.185963] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36f088fb-a7ea-4848-a827-4ee21012ca50',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.689587] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.689587] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.689587] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.689975] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.690220] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.690463] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 36f088fb-a7ea-4848-a827-4ee21012ca50 not found, creating... [ 674.690965] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.691104] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.691301] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.691638] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.691837] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.692280] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.692517] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.692647] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.692948] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.693115] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.693299] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 36f088fb-a7ea-4848-a827-4ee21012ca50 is going to be created. [ 674.717309] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.717309] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.717309] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.717536] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.717987] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.717987] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-36f088fb-a7ea-4848-a827-4ee21012ca50" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.528944] env[67003]: INFO networking_nsxv3.common.synchronization [None req-39dc429d-61f9-4726-a3f0-ee4bb9059cb4 None None] Enqueued Resource ID: 4ff9026b-0cb5-4819-8c6c-efe5ff289ab0 with Priority: HIGHEST for action port [ 675.529540] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ff9026b-0cb5-4819-8c6c-efe5ff289ab0 with Priority: HIGHEST for action port [ 675.529848] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-4ff9026b-0cb5-4819-8c6c-efe5ff289ab0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.529998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4ff9026b-0cb5-4819-8c6c-efe5ff289ab0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.532116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4ff9026b-0cb5-4819-8c6c-efe5ff289ab0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.532963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4ff9026b-0cb5-4819-8c6c-efe5ff289ab0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.532963] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4ff9026b-0cb5-4819-8c6c-efe5ff289ab0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.863104] env[67003]: INFO networking_nsxv3.common.synchronization [req-64030160-0b32-4636-a7b8-283a56ff26ed req-ae6401bc-b9c4-4bf8-a2e9-5d81c0a0eac9 service nova] Enqueued Resource ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e with Priority: HIGHEST for action security_group_rules [ 675.863296] env[67003]: INFO networking_nsxv3.common.synchronization [req-64030160-0b32-4636-a7b8-283a56ff26ed req-ae6401bc-b9c4-4bf8-a2e9-5d81c0a0eac9 service nova] Enqueued Resource ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e with Priority: HIGHEST for action security_group_members [ 675.863447] env[67003]: INFO networking_nsxv3.common.synchronization [req-64030160-0b32-4636-a7b8-283a56ff26ed req-ae6401bc-b9c4-4bf8-a2e9-5d81c0a0eac9 service nova] Enqueued Resource ID: 36f088fb-a7ea-4848-a827-4ee21012ca50 with Priority: HIGHEST for action port [ 675.864018] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e with Priority: HIGHEST for action security_group_rules [ 675.864162] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e with Priority: HIGHEST for action security_group_members [ 675.864304] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36f088fb-a7ea-4848-a827-4ee21012ca50 with Priority: HIGHEST for action port [ 675.864612] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa8a0a38-37aa-4674-acd4-bfc56f11a31e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.864984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.864984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.865158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.865213] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa8a0a38-37aa-4674-acd4-bfc56f11a31e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.866484] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.866484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.866484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.866484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.866664] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.866709] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.866842] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.866906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.866967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.867106] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa8a0a38-37aa-4674-acd4-bfc56f11a31e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.867832] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-36f088fb-a7ea-4848-a827-4ee21012ca50 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.867934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36f088fb-a7ea-4848-a827-4ee21012ca50" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.867985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36f088fb-a7ea-4848-a827-4ee21012ca50" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.874987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36f088fb-a7ea-4848-a827-4ee21012ca50" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.875718] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36f088fb-a7ea-4848-a827-4ee21012ca50',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.035676] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4ff9026b-0cb5-4819-8c6c-efe5ff289ab0 [ 676.035913] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.036059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.036131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.036341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.036428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.036522] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4ff9026b-0cb5-4819-8c6c-efe5ff289ab0 already deleted. [ 676.036601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4ff9026b-0cb5-4819-8c6c-efe5ff289ab0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.378011] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.378354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.378725] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aa8a0a38-37aa-4674-acd4-bfc56f11a31e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.380338] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36f088fb-a7ea-4848-a827-4ee21012ca50 with status ACTIVE [ 676.380509] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.380625] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.380693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.380911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.380998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.381226] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.381376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.381470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.381681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.381796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.382085] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.382253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.382351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.382673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.382673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.382812] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36f088fb-a7ea-4848-a827-4ee21012ca50 is going to be updated. [ 676.410407] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.410521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.410572] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.410776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.410908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.411172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36f088fb-a7ea-4848-a827-4ee21012ca50" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.880631] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aa8a0a38-37aa-4674-acd4-bfc56f11a31e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.087142] env[67003]: INFO networking_nsxv3.common.synchronization [None req-996c9645-a3d8-480e-9634-82c099ee4f02 tempest-ServersTestBootFromVolume-709358174 tempest-ServersTestBootFromVolume-709358174-project-member] Enqueued Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGHEST for action security_group_rules [ 677.087142] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGHEST for action security_group_rules [ 677.087142] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1fb9da3-caa0-493e-935e-25393509c210 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.087142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.088367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.088798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.088919] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1fb9da3-caa0-493e-935e-25393509c210',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.219411] env[67003]: INFO networking_nsxv3.common.synchronization [None req-4c068346-7aca-4669-bb8c-d2324f7bbe91 tempest-ServersTestBootFromVolume-709358174 tempest-ServersTestBootFromVolume-709358174-project-member] Enqueued Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGHEST for action security_group_rules [ 677.220800] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGHEST for action security_group_rules [ 677.221506] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1fb9da3-caa0-493e-935e-25393509c210 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.221642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.386445] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.386697] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.387059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.387059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.387145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.387262] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e is going to be created. [ 677.422496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.427927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.427927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.427927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.427927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.450450] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e in Status: UNINITIALIZED for 2s [ 677.616046] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.616046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.616046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.616046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.616046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.616752] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1fb9da3-caa0-493e-935e-25393509c210 already deleted. [ 677.616752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.616887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.617224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.617224] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1fb9da3-caa0-493e-935e-25393509c210',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.142670] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.143514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.143663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.143852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.143953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.144068] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1fb9da3-caa0-493e-935e-25393509c210 already deleted. [ 678.144158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.448546] env[67003]: INFO networking_nsxv3.common.synchronization [req-7505bd1c-c18d-4dfa-b4c7-997d4bca4c8f req-fed6f66d-b767-4fac-97e9-9765b0907839 tempest-FloatingIPsAssociationNegativeTestJSON-933496267 tempest-FloatingIPsAssociationNegativeTestJSON-933496267-project-member] Enqueued Resource ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 with Priority: HIGHEST for action security_group_members [ 679.449210] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 with Priority: HIGHEST for action security_group_members [ 679.449602] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.449751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.449825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.450093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.450309] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.450430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.450485] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.450838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.450838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.450944] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8df0b4b9-9305-44fa-8ffb-138abad7c0b5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.464365] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e in Status: SUCCESS [ 679.464670] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.465160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.465684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.465684] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.465848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.465908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.466117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.466205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.466304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.466398] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aa8a0a38-37aa-4674-acd4-bfc56f11a31e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.904601] env[67003]: INFO networking_nsxv3.common.synchronization [req-afc68778-d8a7-45c8-aa3d-965d1a1633f5 req-a162a598-f746-4249-9bd6-bc890e10c840 tempest-DeleteServersAdminTestJSON-1035837237 tempest-DeleteServersAdminTestJSON-1035837237-project-member] Enqueued Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_members [ 679.905312] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGHEST for action security_group_members [ 679.905467] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.906042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.906152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.906394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.906582] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.906711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.907707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.908150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.908266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.908420] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.955523] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.955692] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.955761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.955990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.956103] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.956320] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.956454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.956520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.956703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.956783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.956874] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 is going to be updated. [ 679.968936] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.969126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.969189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.969414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.969584] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.969697] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.969798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.969991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.970099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.970190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.970386] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.970492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.970553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.970727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.970838] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.970929] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.971026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.971182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.971261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.971575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.971671] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aa8a0a38-37aa-4674-acd4-bfc56f11a31e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.995562] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.995562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.995562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.995562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.995562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.015605] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 in Status: IN_PROGRESS for 2s [ 680.231338] env[67003]: INFO networking_nsxv3.common.synchronization [req-b83fea8b-4b18-455f-813e-ee9b08afbe2a req-1b36c878-9759-484b-9b19-135bb944006b tempest-ServersV294TestFqdnHostnames-1804776967 tempest-ServersV294TestFqdnHostnames-1804776967-project-member] Enqueued Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGHEST for action security_group_members [ 680.232183] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGHEST for action security_group_members [ 680.232738] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-0984692d-32cd-4b7f-9bd0-7496ca581278 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.232903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.233107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.234610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.234610] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.234610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.234610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.234610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.234610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.234610] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.410946] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.411116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.411210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.411536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.411709] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.412021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.412149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.412217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.412416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.413243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.413243] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 is going to be updated. [ 680.441037] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.441669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.442333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.442333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.442786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.453408] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: IN_PROGRESS for 2s [ 680.474775] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aa8a0a38-37aa-4674-acd4-bfc56f11a31e: rpc.has_security_group_logging(os_id): False [ 680.497802] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.497802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.497802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.497802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.497802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.497802] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.497802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.497802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.498603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.498893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.499287] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.499693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.500088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.500533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.500839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.501187] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.501501] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.501723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.502156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.502365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.503265] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e is going to be created. [ 680.577083] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.577083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.577083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.577294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.577459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.592176] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e in Status: IN_PROGRESS for 2s [ 680.737008] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.737247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.737329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.737752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.737884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.738171] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.738299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.738388] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.738588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.738688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.738813] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 already deleted. [ 680.738927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.693246] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-141 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.693635] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-141" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.693699] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-141" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.693973] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-141" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.694249] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.694420] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.694591] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.696827] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.696827] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.696827] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.696827] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 681.696827] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 681.696827] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 681.696827] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 681.696827] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 681.696827] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 681.719255] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 681.719435] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 681.719575] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 681.719753] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-141" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.720182] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-3165c9a0-b954-4e42-b1d7-062b9ac49d1f taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.720291] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-3165c9a0-b954-4e42-b1d7-062b9ac49d1f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.720632] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-3165c9a0-b954-4e42-b1d7-062b9ac49d1f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.720998] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-3165c9a0-b954-4e42-b1d7-062b9ac49d1f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.721151] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3165c9a0-b954-4e42-b1d7-062b9ac49d1f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.811429] env[67003]: INFO networking_nsxv3.common.synchronization [None req-8e9bb2ce-dfd6-4b80-83e9-87e8f70805e2 None None] Enqueued Resource ID: 675d1b1a-0367-4804-a032-b145803b7c59 with Priority: HIGHEST for action port [ 681.812109] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 675d1b1a-0367-4804-a032-b145803b7c59 with Priority: HIGHEST for action port [ 681.812475] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-675d1b1a-0367-4804-a032-b145803b7c59 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.812644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-675d1b1a-0367-4804-a032-b145803b7c59" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.813589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-675d1b1a-0367-4804-a032-b145803b7c59" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.813909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-675d1b1a-0367-4804-a032-b145803b7c59" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.814111] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('675d1b1a-0367-4804-a032-b145803b7c59',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.065147] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 in Status: SUCCESS [ 682.065439] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 deletion is rescheduled due to dependency. [ 682.065439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.224710] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.224958] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.227863] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.228244] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.228396] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.228818] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 3165c9a0-b954-4e42-b1d7-062b9ac49d1f not found, creating... [ 682.228818] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.229046] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.229111] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.229312] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.229442] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.229723] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.229875] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.229985] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.230205] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.230331] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.230461] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 3165c9a0-b954-4e42-b1d7-062b9ac49d1f is going to be created. [ 682.255123] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.255487] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.255487] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.255711] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.256283] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.256283] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-3165c9a0-b954-4e42-b1d7-062b9ac49d1f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.316973] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 675d1b1a-0367-4804-a032-b145803b7c59 [ 682.317322] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.317516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.317620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.317932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.318085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.318229] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:675d1b1a-0367-4804-a032-b145803b7c59 already deleted. [ 682.318349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-675d1b1a-0367-4804-a032-b145803b7c59" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.467761] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 in Status: SUCCESS [ 682.468047] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 deletion is rescheduled due to dependency. [ 682.468332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.610164] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e in Status: SUCCESS [ 682.610164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.110694] env[67003]: INFO networking_nsxv3.common.synchronization [req-b83fea8b-4b18-455f-813e-ee9b08afbe2a req-ed653eca-eba2-4f52-bfbd-a41f7e108822 service nova] Enqueued Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGHEST for action security_group_rules [ 683.110694] env[67003]: INFO networking_nsxv3.common.synchronization [req-b83fea8b-4b18-455f-813e-ee9b08afbe2a req-ed653eca-eba2-4f52-bfbd-a41f7e108822 service nova] Enqueued Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGHEST for action security_group_members [ 683.110694] env[67003]: INFO networking_nsxv3.common.synchronization [req-b83fea8b-4b18-455f-813e-ee9b08afbe2a req-ed653eca-eba2-4f52-bfbd-a41f7e108822 service nova] Enqueued Resource ID: 3165c9a0-b954-4e42-b1d7-062b9ac49d1f with Priority: HIGHEST for action port [ 683.111113] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGHEST for action security_group_rules [ 683.112146] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGHEST for action security_group_members [ 683.112146] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3165c9a0-b954-4e42-b1d7-062b9ac49d1f with Priority: HIGHEST for action port [ 683.113080] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0984692d-32cd-4b7f-9bd0-7496ca581278 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.117071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.117071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.117071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.117071] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.117071] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-0984692d-32cd-4b7f-9bd0-7496ca581278 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.117071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.117071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.117071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.117071] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.117071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.117071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.117071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.117071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.117071] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.121065] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-3165c9a0-b954-4e42-b1d7-062b9ac49d1f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.121065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3165c9a0-b954-4e42-b1d7-062b9ac49d1f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.121265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3165c9a0-b954-4e42-b1d7-062b9ac49d1f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.121555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3165c9a0-b954-4e42-b1d7-062b9ac49d1f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.121555] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3165c9a0-b954-4e42-b1d7-062b9ac49d1f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.601128] env[67003]: INFO networking_nsxv3.common.synchronization [req-4d1c9c12-323f-4c2f-b33c-3efd7dc71791 req-1460f3e8-886d-434e-90b2-185a116e3252 tempest-ImagesTestJSON-830230457 tempest-ImagesTestJSON-830230457-project-member] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 683.601825] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 683.602184] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.602329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.602381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.602620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.602772] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.602871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.602980] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.603100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.603180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.603272] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.625208] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-0984692d-32cd-4b7f-9bd0-7496ca581278 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.625208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.626093] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.626393] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3165c9a0-b954-4e42-b1d7-062b9ac49d1f with status ACTIVE [ 683.626661] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.626846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.627221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.627766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.628031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.628909] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.628909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.628909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.628909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.628909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.629206] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.629637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.629779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.629987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.630122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.630291] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3165c9a0-b954-4e42-b1d7-062b9ac49d1f is going to be updated. [ 683.655797] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.657601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.657601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.657601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.657601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.657601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3165c9a0-b954-4e42-b1d7-062b9ac49d1f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.108645] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.108833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.108916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.109154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.109246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.109440] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.109544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.109627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.109800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.109886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.110040] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 already deleted. [ 684.110112] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.133719] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.190109] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-423 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.190419] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.190534] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.190986] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.191280] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.191436] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.191574] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.192055] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.192055] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.192609] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.192609] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 684.192609] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 684.192609] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 684.192609] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 684.193043] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 684.193043] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 684.214221] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 684.214638] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 684.214638] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 684.214846] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.215052] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-3e550711-7222-453a-955e-c6e6d32d6900 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.215260] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-3e550711-7222-453a-955e-c6e6d32d6900" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.215369] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-3e550711-7222-453a-955e-c6e6d32d6900" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.216817] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-3e550711-7222-453a-955e-c6e6d32d6900" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.216817] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e550711-7222-453a-955e-c6e6d32d6900',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.240518] env[67003]: INFO networking_nsxv3.common.synchronization [None req-6f827dd2-c1a7-4fee-ba1c-aada25aea80d None None] Enqueued Resource ID: 1620ac83-8fab-4ef0-870e-49af47716004 with Priority: HIGHEST for action port [ 684.241149] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1620ac83-8fab-4ef0-870e-49af47716004 with Priority: HIGHEST for action port [ 684.241396] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-1620ac83-8fab-4ef0-870e-49af47716004 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.241552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1620ac83-8fab-4ef0-870e-49af47716004" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.241627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1620ac83-8fab-4ef0-870e-49af47716004" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.241932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1620ac83-8fab-4ef0-870e-49af47716004" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.242056] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1620ac83-8fab-4ef0-870e-49af47716004',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.636993] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.636993] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.636993] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.637405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.637405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.637405] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 is going to be created. [ 684.674217] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.674217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.674217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.674217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.674217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.685874] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 in Status: UNINITIALIZED for 2s [ 684.721903] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.721903] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.721903] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.721903] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.721903] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.721903] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 3e550711-7222-453a-955e-c6e6d32d6900 not found, creating... [ 684.721903] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.721903] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.721903] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.721903] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.721903] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.722902] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.722902] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.722902] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.722902] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.723090] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.723213] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 3e550711-7222-453a-955e-c6e6d32d6900 is going to be created. [ 684.745161] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.745410] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.745529] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.745798] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.746117] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.746476] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-3e550711-7222-453a-955e-c6e6d32d6900" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.747441] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1620ac83-8fab-4ef0-870e-49af47716004 [ 684.747660] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.747893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.747993] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.748427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.748562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.748675] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1620ac83-8fab-4ef0-870e-49af47716004 already deleted. [ 684.748779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1620ac83-8fab-4ef0-870e-49af47716004" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.245920] env[67003]: INFO networking_nsxv3.common.synchronization [req-517ebacb-00e5-4faf-8101-3c4506b25099 req-890b3519-b3b4-4338-8e11-d89f8961d214 tempest-ServerDiskConfigTestJSON-448903628 tempest-ServerDiskConfigTestJSON-448903628-project-member] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 685.247277] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 685.247710] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.247868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.248360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.248659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.248827] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.248938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.249032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.249187] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.249287] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.249385] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.488880] env[67003]: INFO networking_nsxv3.common.synchronization [req-4d1c9c12-323f-4c2f-b33c-3efd7dc71791 req-4c542d54-d1f2-436d-8416-43fbb04a55f3 service nova] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_rules [ 685.489069] env[67003]: INFO networking_nsxv3.common.synchronization [req-4d1c9c12-323f-4c2f-b33c-3efd7dc71791 req-4c542d54-d1f2-436d-8416-43fbb04a55f3 service nova] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 685.489214] env[67003]: INFO networking_nsxv3.common.synchronization [req-4d1c9c12-323f-4c2f-b33c-3efd7dc71791 req-4c542d54-d1f2-436d-8416-43fbb04a55f3 service nova] Enqueued Resource ID: 3e550711-7222-453a-955e-c6e6d32d6900 with Priority: HIGHEST for action port [ 685.489731] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_rules [ 685.489872] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 685.490025] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e550711-7222-453a-955e-c6e6d32d6900 with Priority: HIGHEST for action port [ 685.490539] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.490664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.490782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.491018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.491120] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.493617] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.493617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.493617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.493617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.493617] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.493617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.493917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.493917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.494514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.494514] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.495368] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e550711-7222-453a-955e-c6e6d32d6900 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.497493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e550711-7222-453a-955e-c6e6d32d6900" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.497493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e550711-7222-453a-955e-c6e6d32d6900" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.497493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e550711-7222-453a-955e-c6e6d32d6900" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.497493] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e550711-7222-453a-955e-c6e6d32d6900',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.753672] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.754404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.754542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.754937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.755061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.755279] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.755396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.755463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.755628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.755822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.755822] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 already deleted. [ 685.755943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.770744] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.770962] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.771119] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.771487] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.772268] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.772268] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.772268] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.772905] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.772905] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.772905] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.773213] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.773213] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.773300] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.773387] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.773586] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.773659] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.793635] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.793826] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 685.793976] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.794154] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.794484] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-b0545359-e019-49e7-be6d-c045d0e8c458 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.794727] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-b0545359-e019-49e7-be6d-c045d0e8c458" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.794851] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-b0545359-e019-49e7-be6d-c045d0e8c458" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.796314] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-b0545359-e019-49e7-be6d-c045d0e8c458" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.796937] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0545359-e019-49e7-be6d-c045d0e8c458',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.001056] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.001254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.001515] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.002727] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e550711-7222-453a-955e-c6e6d32d6900 with status ACTIVE [ 686.002948] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.003090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.003159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.003376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.003563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.003807] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.003935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.003935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.004152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.004238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.004859] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.004859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.004859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.004859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.004859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.004859] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e550711-7222-453a-955e-c6e6d32d6900 is going to be updated. [ 686.030469] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.030640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.030712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.030906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.031063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.031244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e550711-7222-453a-955e-c6e6d32d6900" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.299608] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.299608] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.300258] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.300258] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.300358] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.300498] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port b0545359-e019-49e7-be6d-c045d0e8c458 not found, creating... [ 686.300779] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.301446] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.301446] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.301446] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.301599] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.301765] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.301954] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.302174] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.302419] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.302558] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.302700] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: b0545359-e019-49e7-be6d-c045d0e8c458 is going to be created. [ 686.329551] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.329819] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.329920] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.330134] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.330410] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.330577] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-b0545359-e019-49e7-be6d-c045d0e8c458" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.507631] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.696041] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 in Status: UNINITIALIZED for 4s [ 687.011574] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.011655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.011976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.013643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.013792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.013938] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be created. [ 687.037738] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.037738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.037738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.037933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.038141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.050479] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: UNINITIALIZED for 2s [ 687.082284] env[67003]: INFO networking_nsxv3.common.synchronization [req-517ebacb-00e5-4faf-8101-3c4506b25099 req-f828fbe2-0c05-4cb8-ada5-aa41116bf11e service nova] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_rules [ 687.082484] env[67003]: INFO networking_nsxv3.common.synchronization [req-517ebacb-00e5-4faf-8101-3c4506b25099 req-f828fbe2-0c05-4cb8-ada5-aa41116bf11e service nova] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 687.082696] env[67003]: INFO networking_nsxv3.common.synchronization [req-517ebacb-00e5-4faf-8101-3c4506b25099 req-f828fbe2-0c05-4cb8-ada5-aa41116bf11e service nova] Enqueued Resource ID: b0545359-e019-49e7-be6d-c045d0e8c458 with Priority: HIGHEST for action port [ 687.087097] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_rules [ 687.087272] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 687.087417] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0545359-e019-49e7-be6d-c045d0e8c458 with Priority: HIGHEST for action port [ 687.088081] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.088218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.088288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.088572] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.088665] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.090176] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.090344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.090406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.090599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.090759] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.091804] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.092461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.092461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.092461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.092461] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.093594] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b0545359-e019-49e7-be6d-c045d0e8c458 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.093733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b0545359-e019-49e7-be6d-c045d0e8c458" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.093797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b0545359-e019-49e7-be6d-c045d0e8c458" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.097369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b0545359-e019-49e7-be6d-c045d0e8c458" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.097369] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b0545359-e019-49e7-be6d-c045d0e8c458',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.596700] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.596995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.601302] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.602868] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b0545359-e019-49e7-be6d-c045d0e8c458 with status ACTIVE [ 687.602868] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.602868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.603228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.603396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.603472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.605155] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.605155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.605155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.605155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.605155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.605155] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.605155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.605155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.605155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.605155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.605155] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b0545359-e019-49e7-be6d-c045d0e8c458 is going to be updated. [ 687.628448] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.628655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.628729] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.628913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.629080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.629259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b0545359-e019-49e7-be6d-c045d0e8c458" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.106545] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.613446] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.613785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.613785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.614076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.614142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.614329] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be created. [ 688.640877] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.640877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.641077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.641209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.641438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.655197] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: UNINITIALIZED for 2s [ 688.709612] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 in Status: SUCCESS [ 688.709855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.710467] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.710467] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.710630] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.710630] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.710898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.710898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.710898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.711158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.711158] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.975868] env[67003]: INFO networking_nsxv3.common.synchronization [req-ef250751-bddb-4cdb-b535-bf4d123c2ce2 req-540de3b2-7d6b-475f-8b7b-ecb107c396a5 tempest-ServersTestFqdnHostnames-1925503962 tempest-ServersTestFqdnHostnames-1925503962-project-member] Enqueued Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGHEST for action security_group_members [ 688.976513] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGHEST for action security_group_members [ 688.977085] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64b82baf-96b3-4d2a-a0f3-634fd5e24137 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.977085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.977085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.980448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.980803] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.981610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.981695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.982335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.982335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.982335] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64b82baf-96b3-4d2a-a0f3-634fd5e24137',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.069024] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 689.069024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.069024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.069024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.069024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.069024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.069024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.069024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.069024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.069024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.069024] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.214174] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.489057] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.489313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.489313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.489497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.489554] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.489734] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.489936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.489936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.490084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.490160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.490250] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 is going to be updated. [ 689.526840] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.526840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.526840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.527027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.528167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.541201] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 in Status: IN_PROGRESS for 2s [ 689.573897] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.573897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.573897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.573897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.573897] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.573897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.573897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.573897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.573897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.573897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.573897] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.573897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.573897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.573897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.573897] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.573897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.574674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.574674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.574674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.574674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.574674] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.717519] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0984692d-32cd-4b7f-9bd0-7496ca581278: rpc.has_security_group_logging(os_id): False [ 689.737439] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.738136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.738279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.738518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.738658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.739043] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.739202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.739284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.739464] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.739564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.739694] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 is going to be created. [ 689.863934] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.863934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.863934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.864304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.864500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.881741] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 in Status: IN_PROGRESS for 2s [ 690.077567] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c06f8726-ef82-4058-ad8d-7e0aabd079e1: rpc.has_security_group_logging(os_id): False [ 690.098669] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.100052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.100052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.100332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.100403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.100658] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.100838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.100912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.101115] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.101198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.101397] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.101532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.101625] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.101780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.101857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.102091] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.102179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.102235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.102327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.102403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.102487] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be created. [ 690.179750] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.179943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.179992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.180217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.180410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.201163] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 690.668682] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: UNINITIALIZED for 4s [ 691.303556] env[67003]: INFO networking_nsxv3.common.synchronization [req-b509b7cf-9d16-41db-a255-12903432e486 req-41b2423b-f232-4f79-8df9-3ca59694f457 tempest-ServersAdminTestJSON-1432619756 tempest-ServersAdminTestJSON-1432619756-project-member] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 691.304387] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 691.304536] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.304695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.304758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.306430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.306430] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.306430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.306430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.306430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.306430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.306430] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.553032] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 in Status: SUCCESS [ 691.554603] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 deletion is rescheduled due to dependency. [ 691.554603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.808195] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.900840] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 in Status: SUCCESS [ 691.900840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.129104] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-329 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.129507] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.129665] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.129970] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.130298] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.130504] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.130629] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.130863] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.131331] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.131573] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.131657] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 692.131770] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 692.131878] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 692.132287] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 692.132287] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 692.132421] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 692.156741] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 692.156914] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 692.157077] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 692.157257] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.157577] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-2cbadd0b-bda8-45d3-a12e-b920c78fccb0 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.157751] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-2cbadd0b-bda8-45d3-a12e-b920c78fccb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.157864] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-2cbadd0b-bda8-45d3-a12e-b920c78fccb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.158209] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-2cbadd0b-bda8-45d3-a12e-b920c78fccb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.158364] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cbadd0b-bda8-45d3-a12e-b920c78fccb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.217249] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 692.217569] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.312030] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.661308] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.661532] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.661680] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.662015] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.662197] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.662365] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 2cbadd0b-bda8-45d3-a12e-b920c78fccb0 not found, creating... [ 692.662664] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.663025] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.663025] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.663289] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.663354] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.663610] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.663782] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.663887] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.664125] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.664294] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.664449] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 2cbadd0b-bda8-45d3-a12e-b920c78fccb0 is going to be created. [ 692.677782] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 692.678068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.678249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.678478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.678675] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.678903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.678995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.679241] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.679241] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.679359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.679456] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.689459] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.689658] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.689824] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.690105] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.690365] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.690548] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-2cbadd0b-bda8-45d3-a12e-b920c78fccb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.814507] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.814666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.814766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.815019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.815116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.815218] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 692.873354] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.873511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.873569] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.873813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.873966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.891067] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 693.182597] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.182959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.182959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.183077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.183247] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.183373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.183862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.183862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.184061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.184101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.184259] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.184388] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.184432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.184601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.184852] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.184852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.185028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.185331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.185460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.185556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.185685] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.453867] env[67003]: INFO networking_nsxv3.common.synchronization [req-b509b7cf-9d16-41db-a255-12903432e486 req-7a32d884-789e-4631-8c1f-cb7a5019c153 service nova] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_rules [ 693.454404] env[67003]: INFO networking_nsxv3.common.synchronization [req-b509b7cf-9d16-41db-a255-12903432e486 req-7a32d884-789e-4631-8c1f-cb7a5019c153 service nova] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 693.454404] env[67003]: INFO networking_nsxv3.common.synchronization [req-b509b7cf-9d16-41db-a255-12903432e486 req-7a32d884-789e-4631-8c1f-cb7a5019c153 service nova] Enqueued Resource ID: 2cbadd0b-bda8-45d3-a12e-b920c78fccb0 with Priority: HIGHEST for action port [ 693.454894] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_rules [ 693.459023] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 693.459023] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cbadd0b-bda8-45d3-a12e-b920c78fccb0 with Priority: HIGHEST for action port [ 693.459023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.459023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.459023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.459023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.459023] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.459023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.459023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.459023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cbadd0b-bda8-45d3-a12e-b920c78fccb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.459023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cbadd0b-bda8-45d3-a12e-b920c78fccb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.459023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cbadd0b-bda8-45d3-a12e-b920c78fccb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.459023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cbadd0b-bda8-45d3-a12e-b920c78fccb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.459023] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cbadd0b-bda8-45d3-a12e-b920c78fccb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.690432] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25f0058d-8729-4623-a291-7d3376597063: rpc.has_security_group_logging(os_id): False [ 693.714357] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.714590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.714590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.714799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.714888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.715123] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.715259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.715337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.715521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.715600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.715863] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.716034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.716104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.716263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.716339] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.716538] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.716637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.716693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.716842] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.716919] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.717038] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be created. [ 693.802117] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.802352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.802352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.802533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.802724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.817936] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 693.963706] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.963995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.966309] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cbadd0b-bda8-45d3-a12e-b920c78fccb0 with status ACTIVE [ 693.966608] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.966802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.966916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.967107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.967243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.967425] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.967597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.967712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.967848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.967955] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.968156] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.968324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.968424] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.968521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.968621] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.968810] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cbadd0b-bda8-45d3-a12e-b920c78fccb0 is going to be updated. [ 693.998946] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.999140] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.999196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.999414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.999555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.999717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cbadd0b-bda8-45d3-a12e-b920c78fccb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.826617] env[67003]: INFO networking_nsxv3.common.synchronization [req-dbf9ee89-c18c-4b0a-b1b5-0739867d4f3b req-02d8cadb-b82a-443f-83e9-1023c89db3dd tempest-ImagesOneServerNegativeTestJSON-533995407 tempest-ImagesOneServerNegativeTestJSON-533995407-project-member] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 694.827307] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 694.827735] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.827735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.827868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.828046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.828876] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.828876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.828876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.829087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.829507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.830227] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.900486] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 694.900714] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.900893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.901950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.902070] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.902443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.902522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.902710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.902813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.902958] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.084458] env[67003]: INFO networking_nsxv3.common.synchronization [req-d8a70724-2494-4ab9-b6cb-2fd2392dc2ae req-e854f43e-2105-4b11-afa3-9396adfa748c tempest-InstanceActionsNegativeTestJSON-699013072 tempest-InstanceActionsNegativeTestJSON-699013072-project-member] Enqueued Resource ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e with Priority: HIGHEST for action security_group_members [ 695.085055] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e with Priority: HIGHEST for action security_group_members [ 695.085471] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.085471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.085936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.085936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.086407] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.086407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.086559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.086898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.086978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.087112] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aa8a0a38-37aa-4674-acd4-bfc56f11a31e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.244046] env[67003]: INFO networking_nsxv3.common.synchronization [None req-f6d2ffa4-e804-46c6-aca3-f4574731dc0f None None] Enqueued Resource ID: c4cf9163-a8f5-4019-a58c-09109036df45 with Priority: HIGHEST for action port [ 695.244931] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4cf9163-a8f5-4019-a58c-09109036df45 with Priority: HIGHEST for action port [ 695.247011] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4cf9163-a8f5-4019-a58c-09109036df45 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.247124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4cf9163-a8f5-4019-a58c-09109036df45" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.247225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4cf9163-a8f5-4019-a58c-09109036df45" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.248396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4cf9163-a8f5-4019-a58c-09109036df45" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.248544] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4cf9163-a8f5-4019-a58c-09109036df45',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.332514] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.332684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.332741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.333672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.333672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.333672] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.333672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.333672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.333672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.333672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.333672] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be updated. [ 695.367170] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.367370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.367450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.368036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.368036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.378480] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: IN_PROGRESS for 2s [ 695.409298] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.536613] env[67003]: INFO networking_nsxv3.common.synchronization [None req-7fdcf235-5b9b-4d36-8c35-244f92ced423 None None] Enqueued Resource ID: d757d52c-f68e-4159-81b5-23f3538c1514 with Priority: HIGHEST for action port [ 695.537403] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d757d52c-f68e-4159-81b5-23f3538c1514 with Priority: HIGHEST for action port [ 695.537764] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d757d52c-f68e-4159-81b5-23f3538c1514 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.537878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d757d52c-f68e-4159-81b5-23f3538c1514" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.538073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d757d52c-f68e-4159-81b5-23f3538c1514" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.538419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d757d52c-f68e-4159-81b5-23f3538c1514" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.539804] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d757d52c-f68e-4159-81b5-23f3538c1514',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.593352] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.593352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.593352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.593589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.593589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.593872] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.593940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.594047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.594180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.594455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.594455] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e is going to be updated. [ 695.628356] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.628493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.628601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.629106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.629106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.645709] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e in Status: IN_PROGRESS for 2s [ 695.751833] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c4cf9163-a8f5-4019-a58c-09109036df45 [ 695.752045] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.752186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.752259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.752519] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.752671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.752782] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c4cf9163-a8f5-4019-a58c-09109036df45 already deleted. [ 695.752881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4cf9163-a8f5-4019-a58c-09109036df45" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.831368] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 695.832023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.911370] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.042389] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d757d52c-f68e-4159-81b5-23f3538c1514 [ 696.042687] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.042836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.042910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.043224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.043313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.043411] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d757d52c-f68e-4159-81b5-23f3538c1514 already deleted. [ 696.043489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d757d52c-f68e-4159-81b5-23f3538c1514" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.413255] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.413255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.413255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.413255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.413621] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.413621] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 696.446963] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.447147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.447219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.447422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.447563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.460351] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 696.699370] env[67003]: INFO networking_nsxv3.common.synchronization [req-e1b017e2-d44d-4440-9845-72b01b94718d req-cdd6c523-f671-4c3c-a443-ae8af0044306 tempest-ServerDiagnosticsTest-853880771 tempest-ServerDiagnosticsTest-853880771-project-member] Enqueued Resource ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec with Priority: HIGHEST for action security_group_members [ 696.700676] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec with Priority: HIGHEST for action security_group_members [ 696.701104] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f930f78-bc74-4f34-9558-0ffb6faee5ec taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.701261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.701314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.701898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.702038] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.702156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.702220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.704781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.704781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.704781] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f930f78-bc74-4f34-9558-0ffb6faee5ec',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.199670] env[67003]: INFO networking_nsxv3.common.synchronization [None req-bc0662a4-7135-491a-ba5c-3bf01bf94942 None None] Enqueued Resource ID: 261eb837-c9a5-4c0f-bac0-050203e0e688 with Priority: HIGHEST for action port [ 697.200193] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261eb837-c9a5-4c0f-bac0-050203e0e688 with Priority: HIGHEST for action port [ 697.200456] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-261eb837-c9a5-4c0f-bac0-050203e0e688 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.200596] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-261eb837-c9a5-4c0f-bac0-050203e0e688" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.200703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-261eb837-c9a5-4c0f-bac0-050203e0e688" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.200918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-261eb837-c9a5-4c0f-bac0-050203e0e688" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.201013] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('261eb837-c9a5-4c0f-bac0-050203e0e688',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.207869] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.209131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.209131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.209131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.209131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.209131] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.209131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.209131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.209131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.209131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.209131] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec already deleted. [ 697.209131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.344040] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.344040] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.344040] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.344040] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.344395] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.344395] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.344395] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.344607] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.344745] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.344964] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.347049] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.347240] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.347322] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.348320] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.348320] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.348320] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.369425] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.369598] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 697.369732] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.370223] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.373029] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-985a9334-af0c-49c2-97f4-eac73748459e taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.373029] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-985a9334-af0c-49c2-97f4-eac73748459e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.373029] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-985a9334-af0c-49c2-97f4-eac73748459e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.373029] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-985a9334-af0c-49c2-97f4-eac73748459e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.373029] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('985a9334-af0c-49c2-97f4-eac73748459e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.388899] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: SUCCESS [ 697.389061] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a deletion is rescheduled due to dependency. [ 697.389365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.657171] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e in Status: SUCCESS [ 697.657335] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e deletion is rescheduled due to dependency. [ 697.659044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.704208] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 261eb837-c9a5-4c0f-bac0-050203e0e688 [ 697.704541] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.706726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.706726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.706726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.706726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.706726] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:261eb837-c9a5-4c0f-bac0-050203e0e688 already deleted. [ 697.706726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-261eb837-c9a5-4c0f-bac0-050203e0e688" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.878116] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.878116] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.878116] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.878359] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.878470] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.878625] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 985a9334-af0c-49c2-97f4-eac73748459e not found, creating... [ 697.878935] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.879180] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.879180] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.879392] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.879526] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.879790] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.879980] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.880101] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.880249] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.880371] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.880498] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 985a9334-af0c-49c2-97f4-eac73748459e is going to be created. [ 697.904044] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.904044] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.904248] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.904430] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.904685] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.904916] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-985a9334-af0c-49c2-97f4-eac73748459e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.110754] env[67003]: INFO networking_nsxv3.common.synchronization [None req-42a5c4b0-cdc0-4257-b46b-71440413f454 None None] Enqueued Resource ID: 1147a2d0-d7b0-4af0-9dba-16739bf06538 with Priority: HIGHEST for action port [ 698.111308] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1147a2d0-d7b0-4af0-9dba-16739bf06538 with Priority: HIGHEST for action port [ 698.111629] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-1147a2d0-d7b0-4af0-9dba-16739bf06538 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.111808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1147a2d0-d7b0-4af0-9dba-16739bf06538" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.111888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1147a2d0-d7b0-4af0-9dba-16739bf06538" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.112147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1147a2d0-d7b0-4af0-9dba-16739bf06538" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.112231] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1147a2d0-d7b0-4af0-9dba-16739bf06538',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.470376] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 698.470697] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.470816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.470984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.471210] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.471298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.471417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.471518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.471600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.471685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.471777] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.615787] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1147a2d0-d7b0-4af0-9dba-16739bf06538 [ 698.615787] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.615787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.615787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.615787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.615787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.615787] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1147a2d0-d7b0-4af0-9dba-16739bf06538 already deleted. [ 698.615787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1147a2d0-d7b0-4af0-9dba-16739bf06538" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.663769] env[67003]: INFO networking_nsxv3.common.synchronization [req-e1b017e2-d44d-4440-9845-72b01b94718d req-cc721370-76ee-4626-a2c1-be5eb8a59ef7 service nova] Enqueued Resource ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec with Priority: HIGHEST for action security_group_rules [ 698.663971] env[67003]: INFO networking_nsxv3.common.synchronization [req-e1b017e2-d44d-4440-9845-72b01b94718d req-cc721370-76ee-4626-a2c1-be5eb8a59ef7 service nova] Enqueued Resource ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec with Priority: HIGHEST for action security_group_members [ 698.664104] env[67003]: INFO networking_nsxv3.common.synchronization [req-e1b017e2-d44d-4440-9845-72b01b94718d req-cc721370-76ee-4626-a2c1-be5eb8a59ef7 service nova] Enqueued Resource ID: 985a9334-af0c-49c2-97f4-eac73748459e with Priority: HIGHEST for action port [ 698.665251] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec with Priority: HIGHEST for action security_group_rules [ 698.665251] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec with Priority: HIGHEST for action security_group_members [ 698.665251] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 985a9334-af0c-49c2-97f4-eac73748459e with Priority: HIGHEST for action port [ 698.666385] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f930f78-bc74-4f34-9558-0ffb6faee5ec taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.666551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.666582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.666834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.666931] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f930f78-bc74-4f34-9558-0ffb6faee5ec',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.668824] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f930f78-bc74-4f34-9558-0ffb6faee5ec taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.669086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.669169] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.669498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.669828] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.670204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.670204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.670448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.670590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.670709] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f930f78-bc74-4f34-9558-0ffb6faee5ec',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.672553] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-985a9334-af0c-49c2-97f4-eac73748459e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.673271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-985a9334-af0c-49c2-97f4-eac73748459e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.673428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-985a9334-af0c-49c2-97f4-eac73748459e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.673823] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-985a9334-af0c-49c2-97f4-eac73748459e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.674909] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('985a9334-af0c-49c2-97f4-eac73748459e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.976342] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.976485] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.977418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.977418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.977418] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.977418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.977418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.977418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.977418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.977418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.977748] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.977748] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.977748] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.977839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.977932] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.978186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.978186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.978259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.978284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.979030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.979030] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.171029] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f930f78-bc74-4f34-9558-0ffb6faee5ec taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.171029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.181043] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f930f78-bc74-4f34-9558-0ffb6faee5ec',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.181810] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 985a9334-af0c-49c2-97f4-eac73748459e with status ACTIVE [ 699.182060] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.182190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.182324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.184061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.184061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.184061] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.184061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.184061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.184061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.184061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.184061] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.184061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.184061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.184541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.184541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.184541] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 985a9334-af0c-49c2-97f4-eac73748459e is going to be updated. [ 699.209482] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.212360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.212491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.212774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.212960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.213180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-985a9334-af0c-49c2-97f4-eac73748459e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.482068] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a47e002a-325f-4303-8dea-86209028ebb0: rpc.has_security_group_logging(os_id): False [ 699.509190] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.509342] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.509415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.509706] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.509816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.510875] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.511047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.511137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.511324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.511405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.511618] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.511696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.512093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.512093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.512093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.512285] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.512285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.512285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.512468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.512468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.512532] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 699.582091] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.582220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.582287] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.582495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.582775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.604128] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 699.687315] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f930f78-bc74-4f34-9558-0ffb6faee5ec',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.000976] env[67003]: INFO networking_nsxv3.common.synchronization [None req-b99dc158-6f4d-4971-bcc4-1d1b64921ccf None None] Enqueued Resource ID: dd950d1d-5c5b-496a-8722-2757a0ae6526 with Priority: HIGHEST for action port [ 700.001382] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd950d1d-5c5b-496a-8722-2757a0ae6526 with Priority: HIGHEST for action port [ 700.001861] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd950d1d-5c5b-496a-8722-2757a0ae6526 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.001861] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd950d1d-5c5b-496a-8722-2757a0ae6526" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.001861] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd950d1d-5c5b-496a-8722-2757a0ae6526" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.002203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd950d1d-5c5b-496a-8722-2757a0ae6526" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.002284] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd950d1d-5c5b-496a-8722-2757a0ae6526',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.191577] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.191895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.191895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.192050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.192355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.193211] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec is going to be created. [ 700.219761] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.219761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.219869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.220151] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.220712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.232213] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec in Status: UNINITIALIZED for 2s [ 700.505916] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dd950d1d-5c5b-496a-8722-2757a0ae6526 [ 700.505916] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.505916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.506323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.507040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.507040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.507202] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dd950d1d-5c5b-496a-8722-2757a0ae6526 already deleted. [ 700.507254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd950d1d-5c5b-496a-8722-2757a0ae6526" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.625356] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 701.625608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.243654] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec in Status: SUCCESS [ 702.243654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.243654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.244492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.244492] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.244492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.244492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.244492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.244699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.244699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.244699] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f930f78-bc74-4f34-9558-0ffb6faee5ec',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.370119] env[67003]: INFO networking_nsxv3.common.synchronization [None req-4d5e7aa6-e206-4dae-9b15-b8d850497047 None None] Enqueued Resource ID: 18d4a3c7-9306-4815-b951-ae44ebb3a996 with Priority: HIGHEST for action port [ 702.373357] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18d4a3c7-9306-4815-b951-ae44ebb3a996 with Priority: HIGHEST for action port [ 702.373357] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-18d4a3c7-9306-4815-b951-ae44ebb3a996 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.373357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18d4a3c7-9306-4815-b951-ae44ebb3a996" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.373357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18d4a3c7-9306-4815-b951-ae44ebb3a996" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.373357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18d4a3c7-9306-4815-b951-ae44ebb3a996" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.373357] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18d4a3c7-9306-4815-b951-ae44ebb3a996',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.747567] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f930f78-bc74-4f34-9558-0ffb6faee5ec taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.747987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.747987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.748494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.748742] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.748896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.749018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.749202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.749296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.749409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.749559] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f930f78-bc74-4f34-9558-0ffb6faee5ec taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.749666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.749732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.749888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.750110] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.750220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.750271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.750416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.750493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.750590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.750680] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f930f78-bc74-4f34-9558-0ffb6faee5ec',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.875128] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 18d4a3c7-9306-4815-b951-ae44ebb3a996 [ 702.875128] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.875307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.875384] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.875604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.875745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.875784] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:18d4a3c7-9306-4815-b951-ae44ebb3a996 already deleted. [ 702.875857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18d4a3c7-9306-4815-b951-ae44ebb3a996" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.255031] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f930f78-bc74-4f34-9558-0ffb6faee5ec: rpc.has_security_group_logging(os_id): False [ 703.273902] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.273981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.274025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.274250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.274356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.274728] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.274728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.274728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.274883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.274981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.275258] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.275258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.275352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.275416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.275493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.275670] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.275775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.275840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.275978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.276066] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.276165] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec is going to be created. [ 703.338177] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.338335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.338426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.338654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.338852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.354319] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec in Status: IN_PROGRESS for 2s [ 703.940462] env[67003]: INFO networking_nsxv3.common.synchronization [req-d69a130e-0261-4144-a0ea-6a6ad242ae58 req-ed99750c-98c8-496f-a253-0f12db895cef tempest-ServersTestMultiNic-1026664683 tempest-ServersTestMultiNic-1026664683-project-member] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 703.942375] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 703.942938] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.943235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.943315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.943524] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.943688] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.945333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.945503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.945701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.945799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.945922] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.294691] env[67003]: INFO networking_nsxv3.common.synchronization [req-d69a130e-0261-4144-a0ea-6a6ad242ae58 req-d86d5157-4853-4f7f-b35b-0f5561e69322 tempest-ServersTestMultiNic-1026664683 tempest-ServersTestMultiNic-1026664683-project-member] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 704.295751] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 704.297040] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.297173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.452247] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.452247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.452247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.452247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.452247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.452247] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.452247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.452247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.452247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.452247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.452247] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 704.480174] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.480322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.480391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.480610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.480752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.497801] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 704.698781] env[67003]: INFO networking_nsxv3.common.synchronization [req-8d251006-c775-4294-88b3-cada77b7ba71 req-ea4bc2ff-860d-4731-a68d-bc6f98707e41 tempest-VolumesAssistedSnapshotsTest-908302373 tempest-VolumesAssistedSnapshotsTest-908302373-project-member] Enqueued Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGHEST for action security_group_members [ 704.699640] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGHEST for action security_group_members [ 704.700134] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a279ae9a-5f5b-4b3f-a403-fcef8683474d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.700323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.700429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.700747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.700987] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.701139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.701218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.701363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.701501] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.701551] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a279ae9a-5f5b-4b3f-a403-fcef8683474d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.798190] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-600 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.798190] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-600" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.798190] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-600" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.798190] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-600" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.798190] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.798190] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.798190] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.798190] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.798190] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.798500] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.798500] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 704.798551] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 704.798669] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 704.798751] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 704.798833] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 704.798951] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 704.823033] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 704.823033] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 704.823033] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 704.823171] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-600" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.823399] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-b9049951-36af-4657-9393-df4a0afaf2d1 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.823637] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-b9049951-36af-4657-9393-df4a0afaf2d1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.823950] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-b9049951-36af-4657-9393-df4a0afaf2d1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.824341] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-b9049951-36af-4657-9393-df4a0afaf2d1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.824485] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9049951-36af-4657-9393-df4a0afaf2d1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.206451] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.206451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.206451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.206451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.206451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.206451] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.206451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.206451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.206451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.206451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.206451] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d is going to be updated. [ 705.236928] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.236928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.236928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.236928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.236928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.245341] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d in Status: IN_PROGRESS for 2s [ 705.328435] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.328435] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.328435] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.328435] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.328435] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.328632] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port b9049951-36af-4657-9393-df4a0afaf2d1 not found, creating... [ 705.328782] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.329500] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.329500] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.329500] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.329500] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.329710] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.329860] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.329916] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.330073] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.330203] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.330335] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: b9049951-36af-4657-9393-df4a0afaf2d1 is going to be created. [ 705.357108] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.357508] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.357687] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.357969] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.358218] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.358464] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-b9049951-36af-4657-9393-df4a0afaf2d1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.371068] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec in Status: SUCCESS [ 705.371348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.133046] env[67003]: INFO networking_nsxv3.common.synchronization [req-d69a130e-0261-4144-a0ea-6a6ad242ae58 req-879b2a11-1b95-4c08-9e81-6944598c73a7 service nova] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_rules [ 706.133046] env[67003]: INFO networking_nsxv3.common.synchronization [req-d69a130e-0261-4144-a0ea-6a6ad242ae58 req-879b2a11-1b95-4c08-9e81-6944598c73a7 service nova] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 706.133046] env[67003]: INFO networking_nsxv3.common.synchronization [req-d69a130e-0261-4144-a0ea-6a6ad242ae58 req-879b2a11-1b95-4c08-9e81-6944598c73a7 service nova] Enqueued Resource ID: b9049951-36af-4657-9393-df4a0afaf2d1 with Priority: HIGHEST for action port [ 706.133046] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_rules [ 706.133046] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 706.133046] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b9049951-36af-4657-9393-df4a0afaf2d1 with Priority: HIGHEST for action port [ 706.133046] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.133046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.133046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.136762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.136762] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.138068] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.138068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.138068] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b9049951-36af-4657-9393-df4a0afaf2d1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.138068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b9049951-36af-4657-9393-df4a0afaf2d1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.138068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b9049951-36af-4657-9393-df4a0afaf2d1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.138373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b9049951-36af-4657-9393-df4a0afaf2d1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.138373] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b9049951-36af-4657-9393-df4a0afaf2d1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.510065] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 706.510367] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 deletion is rescheduled due to dependency. [ 706.510367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.510520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.510730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.511672] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.511672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.511672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.511672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.511672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.511672] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.642684] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.642684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.643511] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b9049951-36af-4657-9393-df4a0afaf2d1 with status ACTIVE [ 706.643821] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.643961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.644040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.644278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.644366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.644541] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.644636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.644695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.644907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.644989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.645182] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.645272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.645330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.647154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.647154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.647154] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b9049951-36af-4657-9393-df4a0afaf2d1 is going to be updated. [ 706.699324] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.699634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.699634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.699925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.700033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.700243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b9049951-36af-4657-9393-df4a0afaf2d1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.015603] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.075481] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-783 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.075879] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-783" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.076259] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-783" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.076626] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-783" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.077020] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.077264] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.077422] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.077844] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.077900] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.078237] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.078425] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 707.078718] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 707.078878] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 707.079036] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 707.079206] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 707.079370] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 707.102559] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 707.102738] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 707.102944] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 707.103485] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-783" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.103485] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-f473bd3a-1632-4e73-9ad7-e786b2fb4b75 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.103598] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-f473bd3a-1632-4e73-9ad7-e786b2fb4b75" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.103716] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-f473bd3a-1632-4e73-9ad7-e786b2fb4b75" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.104154] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-f473bd3a-1632-4e73-9ad7-e786b2fb4b75" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.104230] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f473bd3a-1632-4e73-9ad7-e786b2fb4b75',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.258941] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d in Status: SUCCESS [ 707.259200] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d deletion is rescheduled due to dependency. [ 707.259265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.520779] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.611747] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.611747] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.611747] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.611747] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.611747] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.613943] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port f473bd3a-1632-4e73-9ad7-e786b2fb4b75 not found, creating... [ 707.613943] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.613943] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.613943] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.613943] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.613943] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.614486] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.614696] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.614921] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.615264] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.615416] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.615569] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: f473bd3a-1632-4e73-9ad7-e786b2fb4b75 is going to be created. [ 707.637662] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.638284] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.638802] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.639479] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.639910] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.640232] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-f473bd3a-1632-4e73-9ad7-e786b2fb4b75" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.024693] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.025229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.025229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.026138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.026138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.026138] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 708.052881] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.053243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.053365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.053610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.053869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.063338] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 708.318639] env[67003]: INFO networking_nsxv3.common.synchronization [req-d69a130e-0261-4144-a0ea-6a6ad242ae58 req-33635028-965b-44d0-812a-0b2c16db5c20 service nova] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_rules [ 708.318888] env[67003]: INFO networking_nsxv3.common.synchronization [req-d69a130e-0261-4144-a0ea-6a6ad242ae58 req-33635028-965b-44d0-812a-0b2c16db5c20 service nova] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 708.319098] env[67003]: INFO networking_nsxv3.common.synchronization [req-d69a130e-0261-4144-a0ea-6a6ad242ae58 req-33635028-965b-44d0-812a-0b2c16db5c20 service nova] Enqueued Resource ID: f473bd3a-1632-4e73-9ad7-e786b2fb4b75 with Priority: HIGHEST for action port [ 708.319812] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_rules [ 708.319996] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 708.322921] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f473bd3a-1632-4e73-9ad7-e786b2fb4b75 with Priority: HIGHEST for action port [ 708.323513] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.323666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.326146] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.326279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.326567] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-f473bd3a-1632-4e73-9ad7-e786b2fb4b75 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.326696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f473bd3a-1632-4e73-9ad7-e786b2fb4b75" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.326750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f473bd3a-1632-4e73-9ad7-e786b2fb4b75" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.327165] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f473bd3a-1632-4e73-9ad7-e786b2fb4b75" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.327282] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f473bd3a-1632-4e73-9ad7-e786b2fb4b75',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.831690] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f473bd3a-1632-4e73-9ad7-e786b2fb4b75 with status ACTIVE [ 708.831690] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.831690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.831690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.831690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.831690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.831690] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.831690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.831690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.831690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.831690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.832488] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.832488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.832488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.832488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.832488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.832488] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f473bd3a-1632-4e73-9ad7-e786b2fb4b75 is going to be updated. [ 708.859077] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.859077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.859077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.859077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.859077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.859077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f473bd3a-1632-4e73-9ad7-e786b2fb4b75" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.074368] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 710.074656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.074868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.075100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.075285] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.075411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.076632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.076632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.076632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.076632] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.460589] env[67003]: INFO networking_nsxv3.common.synchronization [None req-f1237dae-2363-4b63-9809-0b107d7568c0 None None] Enqueued Resource ID: 19116ce9-8f8f-419f-ba23-76177de6d120 with Priority: HIGHEST for action port [ 710.464250] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 19116ce9-8f8f-419f-ba23-76177de6d120 with Priority: HIGHEST for action port [ 710.464250] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-19116ce9-8f8f-419f-ba23-76177de6d120 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.464250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-19116ce9-8f8f-419f-ba23-76177de6d120" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.464250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-19116ce9-8f8f-419f-ba23-76177de6d120" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.464250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-19116ce9-8f8f-419f-ba23-76177de6d120" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.464250] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('19116ce9-8f8f-419f-ba23-76177de6d120',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.578412] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.749642] env[67003]: INFO networking_nsxv3.common.synchronization [None req-bf8be89b-2d15-4684-90ea-3fde60455eae None None] Enqueued Resource ID: e4c944bb-4479-4b11-bd44-836fcca8a6a9 with Priority: HIGHEST for action port [ 710.750772] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4c944bb-4479-4b11-bd44-836fcca8a6a9 with Priority: HIGHEST for action port [ 710.750772] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4c944bb-4479-4b11-bd44-836fcca8a6a9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.750966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4c944bb-4479-4b11-bd44-836fcca8a6a9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.750966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4c944bb-4479-4b11-bd44-836fcca8a6a9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.752247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4c944bb-4479-4b11-bd44-836fcca8a6a9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.752247] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4c944bb-4479-4b11-bd44-836fcca8a6a9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.968152] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 19116ce9-8f8f-419f-ba23-76177de6d120 [ 710.968381] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.968551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.968625] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.968875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.968967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.969244] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:19116ce9-8f8f-419f-ba23-76177de6d120 already deleted. [ 710.969244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-19116ce9-8f8f-419f-ba23-76177de6d120" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.080837] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.255294] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4c944bb-4479-4b11-bd44-836fcca8a6a9 [ 711.255409] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.255537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.255604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.255810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.255898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.255987] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4c944bb-4479-4b11-bd44-836fcca8a6a9 already deleted. [ 711.256079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4c944bb-4479-4b11-bd44-836fcca8a6a9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.584739] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.584739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.584739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.584951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.584951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.585013] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 711.617823] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.617945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.618025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.618248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.618430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.632189] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 712.862602] env[67003]: INFO networking_nsxv3.common.synchronization [None req-64083163-156f-4f67-b881-1415274075ed None None] Enqueued Resource ID: 2668c01a-d01a-4495-93cb-639434c19666 with Priority: HIGHEST for action port [ 712.864183] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2668c01a-d01a-4495-93cb-639434c19666 with Priority: HIGHEST for action port [ 712.865294] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2668c01a-d01a-4495-93cb-639434c19666 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.865755] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2668c01a-d01a-4495-93cb-639434c19666" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.865880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2668c01a-d01a-4495-93cb-639434c19666" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.866317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2668c01a-d01a-4495-93cb-639434c19666" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.866409] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2668c01a-d01a-4495-93cb-639434c19666',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.370638] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2668c01a-d01a-4495-93cb-639434c19666 [ 713.370869] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.370998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.371136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.371414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.371616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.371923] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2668c01a-d01a-4495-93cb-639434c19666 already deleted. [ 713.372029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2668c01a-d01a-4495-93cb-639434c19666" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.513352] env[67003]: INFO networking_nsxv3.common.synchronization [None req-32b09c29-807d-4897-976b-9842631a6d94 None None] Enqueued Resource ID: 17ef9efb-756b-4f63-a46a-f17f2b481c2b with Priority: HIGHEST for action port [ 713.513652] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17ef9efb-756b-4f63-a46a-f17f2b481c2b with Priority: HIGHEST for action port [ 713.514235] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-17ef9efb-756b-4f63-a46a-f17f2b481c2b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.514235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17ef9efb-756b-4f63-a46a-f17f2b481c2b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.514425] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17ef9efb-756b-4f63-a46a-f17f2b481c2b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.514547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17ef9efb-756b-4f63-a46a-f17f2b481c2b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.514615] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17ef9efb-756b-4f63-a46a-f17f2b481c2b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.647940] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 713.648186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.648351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.648559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.648748] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.648866] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.648930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.651081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.651186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.651367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.651482] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.652404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.653031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.653031] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.653031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.653031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.653196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.653243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.653374] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.017485] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17ef9efb-756b-4f63-a46a-f17f2b481c2b [ 714.017759] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.017846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.017912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.018142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.018223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.018313] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17ef9efb-756b-4f63-a46a-f17f2b481c2b already deleted. [ 714.018391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17ef9efb-756b-4f63-a46a-f17f2b481c2b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.159392] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.159558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.159730] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.664659] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.161970] env[67003]: INFO networking_nsxv3.common.synchronization [None req-51df3242-7437-4051-b07e-2db25f860675 None None] Enqueued Resource ID: 7177b079-f43d-438d-b8f2-bafd3967390c with Priority: HIGHEST for action port [ 715.162473] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7177b079-f43d-438d-b8f2-bafd3967390c with Priority: HIGHEST for action port [ 715.162764] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-7177b079-f43d-438d-b8f2-bafd3967390c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.162888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7177b079-f43d-438d-b8f2-bafd3967390c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.162947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7177b079-f43d-438d-b8f2-bafd3967390c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.163204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7177b079-f43d-438d-b8f2-bafd3967390c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.163281] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7177b079-f43d-438d-b8f2-bafd3967390c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.171359] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.171499] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.171568] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.171789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.171877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.171970] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 715.209190] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.209330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.209402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.209622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.209766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.223023] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 715.667534] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7177b079-f43d-438d-b8f2-bafd3967390c [ 715.667804] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.667976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.668062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.668320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.668421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.668513] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7177b079-f43d-438d-b8f2-bafd3967390c already deleted. [ 715.668599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7177b079-f43d-438d-b8f2-bafd3967390c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.753268] env[67003]: INFO networking_nsxv3.common.synchronization [req-d08933ac-a1f6-40cc-b1f3-917e034ad8d3 req-d08f4562-8626-425e-8ed3-4c523674d69b tempest-SecurityGroupRulesTestJSON-1633668150 tempest-SecurityGroupRulesTestJSON-1633668150-project-member] Enqueued Resource ID: 1ecba222-b797-4b67-a51c-ce5a4d544f1f with Priority: HIGHEST for action security_group_rules [ 715.753436] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1ecba222-b797-4b67-a51c-ce5a4d544f1f with Priority: HIGHEST for action security_group_rules [ 715.754642] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1ecba222-b797-4b67-a51c-ce5a4d544f1f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.754829] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1ecba222-b797-4b67-a51c-ce5a4d544f1f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.754952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1ecba222-b797-4b67-a51c-ce5a4d544f1f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.755264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1ecba222-b797-4b67-a51c-ce5a4d544f1f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.755359] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1ecba222-b797-4b67-a51c-ce5a4d544f1f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.204764] env[67003]: INFO networking_nsxv3.common.synchronization [None req-0c45ba1f-8045-4701-b877-b658afb9cedf None None] Enqueued Resource ID: f9eac428-805a-425f-a4cd-4ac3402265bc with Priority: HIGHEST for action port [ 716.205321] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f9eac428-805a-425f-a4cd-4ac3402265bc with Priority: HIGHEST for action port [ 716.205616] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-f9eac428-805a-425f-a4cd-4ac3402265bc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.205850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f9eac428-805a-425f-a4cd-4ac3402265bc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.205850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f9eac428-805a-425f-a4cd-4ac3402265bc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.206392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f9eac428-805a-425f-a4cd-4ac3402265bc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.206538] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f9eac428-805a-425f-a4cd-4ac3402265bc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.277837] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.278041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.278281] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.278553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.278682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.278880] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1ecba222-b797-4b67-a51c-ce5a4d544f1f already deleted. [ 716.278997] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1ecba222-b797-4b67-a51c-ce5a4d544f1f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.314599] env[67003]: INFO networking_nsxv3.common.synchronization [req-18db7baa-39d0-412e-abed-0bb0871d1445 req-7c887b14-e073-4368-8374-351aff83acf0 tempest-ImagesOneServerTestJSON-1569564112 tempest-ImagesOneServerTestJSON-1569564112-project-member] Enqueued Resource ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e with Priority: HIGHEST for action security_group_members [ 716.315112] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e with Priority: HIGHEST for action security_group_members [ 716.316190] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.316389] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.316507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.317640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.317640] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.317640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.317640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.317640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.317860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.318204] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e34b189-aa15-4302-9a41-1a1ce1edfa1e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.711115] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f9eac428-805a-425f-a4cd-4ac3402265bc [ 716.711115] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.712889] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.713027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.713250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.713356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.713544] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f9eac428-805a-425f-a4cd-4ac3402265bc already deleted. [ 716.713544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f9eac428-805a-425f-a4cd-4ac3402265bc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.715056] env[67003]: INFO networking_nsxv3.common.synchronization [None req-b4c38d11-4539-4ce1-b613-59a860292d10 None None] Enqueued Resource ID: b736c29f-37d2-4bcb-a452-04237af75159 with Priority: HIGHEST for action port [ 716.715837] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b736c29f-37d2-4bcb-a452-04237af75159 with Priority: HIGHEST for action port [ 716.716619] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b736c29f-37d2-4bcb-a452-04237af75159 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.716848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b736c29f-37d2-4bcb-a452-04237af75159" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.716952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b736c29f-37d2-4bcb-a452-04237af75159" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.717265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b736c29f-37d2-4bcb-a452-04237af75159" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.717357] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b736c29f-37d2-4bcb-a452-04237af75159',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.822745] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.822931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.822931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.823195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.823443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.823574] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.823707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.823744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.823931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.823997] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.824505] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e already deleted. [ 716.824505] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.881416] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-721 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.881744] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-721" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.881980] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-721" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.882395] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-721" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.882728] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.882891] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.883016] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.883239] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.883375] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.883580] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.883686] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.883788] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.884098] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.884855] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.884855] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.884855] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.908378] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.908541] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 716.908677] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.908856] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-721" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.909836] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-d858c6b3-719f-4276-b2c1-88e3486d600b taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.909836] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-d858c6b3-719f-4276-b2c1-88e3486d600b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.909836] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-d858c6b3-719f-4276-b2c1-88e3486d600b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.910093] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-d858c6b3-719f-4276-b2c1-88e3486d600b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.910228] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d858c6b3-719f-4276-b2c1-88e3486d600b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.222564] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b736c29f-37d2-4bcb-a452-04237af75159 [ 717.222564] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.222564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.222564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.222564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.222564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.222564] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b736c29f-37d2-4bcb-a452-04237af75159 already deleted. [ 717.222564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b736c29f-37d2-4bcb-a452-04237af75159" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.234697] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 717.235086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.235614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.235845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.236050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.236178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.236248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.236390] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.236467] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.236541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.236697] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.236781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.236833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.237051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.237131] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.237222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.237295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.237405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.237536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.237612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.237682] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.417023] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.417023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.417023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.417023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.417023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.417023] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port d858c6b3-719f-4276-b2c1-88e3486d600b not found, creating... [ 717.417023] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.417023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.417023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.417023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.417023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.417564] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.417564] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.417564] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.417564] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.417564] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.417564] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: d858c6b3-719f-4276-b2c1-88e3486d600b is going to be created. [ 717.444429] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.444669] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.444931] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.445491] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.445550] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.445910] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-d858c6b3-719f-4276-b2c1-88e3486d600b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.745593] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a631474-f774-4747-8676-6477b61cae29: rpc.has_security_group_logging(os_id): False [ 717.777138] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.777138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.777138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.777305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.777305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.777305] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.777305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.777305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.777305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.778734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.781318] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.782255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.782255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.782255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.782255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.782255] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.782255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.782501] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.782501] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.782556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.782660] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 717.866239] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.866239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.866239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.866239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.866239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.887035] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 718.296380] env[67003]: INFO networking_nsxv3.common.synchronization [req-18db7baa-39d0-412e-abed-0bb0871d1445 req-79208fe9-0729-4415-a65f-5651cfe6fb8a service nova] Enqueued Resource ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e with Priority: HIGHEST for action security_group_rules [ 718.296380] env[67003]: INFO networking_nsxv3.common.synchronization [req-18db7baa-39d0-412e-abed-0bb0871d1445 req-79208fe9-0729-4415-a65f-5651cfe6fb8a service nova] Enqueued Resource ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e with Priority: HIGHEST for action security_group_members [ 718.296657] env[67003]: INFO networking_nsxv3.common.synchronization [req-18db7baa-39d0-412e-abed-0bb0871d1445 req-79208fe9-0729-4415-a65f-5651cfe6fb8a service nova] Enqueued Resource ID: d858c6b3-719f-4276-b2c1-88e3486d600b with Priority: HIGHEST for action port [ 718.299796] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e with Priority: HIGHEST for action security_group_rules [ 718.299796] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e with Priority: HIGHEST for action security_group_members [ 718.299796] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d858c6b3-719f-4276-b2c1-88e3486d600b with Priority: HIGHEST for action port [ 718.299796] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e34b189-aa15-4302-9a41-1a1ce1edfa1e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.299796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.299796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.299796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.299796] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e34b189-aa15-4302-9a41-1a1ce1edfa1e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.301383] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.301383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.301383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.302808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.302808] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.302808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.302808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.302808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.302808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.303077] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e34b189-aa15-4302-9a41-1a1ce1edfa1e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.304992] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d858c6b3-719f-4276-b2c1-88e3486d600b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.304992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d858c6b3-719f-4276-b2c1-88e3486d600b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.304992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d858c6b3-719f-4276-b2c1-88e3486d600b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.304992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d858c6b3-719f-4276-b2c1-88e3486d600b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.304992] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d858c6b3-719f-4276-b2c1-88e3486d600b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.807454] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.807582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.807782] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5e34b189-aa15-4302-9a41-1a1ce1edfa1e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.809021] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d858c6b3-719f-4276-b2c1-88e3486d600b with status ACTIVE [ 718.809458] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.809458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.809458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.810455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.810455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.810455] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.810455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.810455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.810455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.810455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.810455] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.810455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.810851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.810851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.810851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.810851] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d858c6b3-719f-4276-b2c1-88e3486d600b is going to be updated. [ 718.832906] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.833136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.833136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.833685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.833685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.833862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d858c6b3-719f-4276-b2c1-88e3486d600b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.313139] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5e34b189-aa15-4302-9a41-1a1ce1edfa1e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.820020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.820225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.820286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.820484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.820603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.820715] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e is going to be created. [ 719.823954] env[67003]: INFO networking_nsxv3.common.synchronization [req-629b4f7f-7ba4-4cfe-bd0f-d662bc1cb22f req-6ecac6c5-ce7d-4a6c-b62e-8395d759c0c3 tempest-SecurityGroupRulesTestJSON-1633668150 tempest-SecurityGroupRulesTestJSON-1633668150-project-member] Enqueued Resource ID: bd73bc41-beaa-4350-bdeb-1358b47940d5 with Priority: HIGHEST for action security_group_rules [ 719.824690] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd73bc41-beaa-4350-bdeb-1358b47940d5 with Priority: HIGHEST for action security_group_rules [ 719.826685] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bd73bc41-beaa-4350-bdeb-1358b47940d5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.827541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bd73bc41-beaa-4350-bdeb-1358b47940d5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.827541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bd73bc41-beaa-4350-bdeb-1358b47940d5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.827794] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bd73bc41-beaa-4350-bdeb-1358b47940d5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.827794] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bd73bc41-beaa-4350-bdeb-1358b47940d5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.852257] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.852988] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.852988] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.852988] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.852988] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.863769] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e in Status: UNINITIALIZED for 2s [ 719.905415] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 719.905415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.905415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.905415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.905415] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.357058] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.357593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.357593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.357593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.357593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.357843] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bd73bc41-beaa-4350-bdeb-1358b47940d5 already deleted. [ 720.357843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bd73bc41-beaa-4350-bdeb-1358b47940d5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.399383] env[67003]: INFO networking_nsxv3.common.synchronization [req-082f87a4-642d-420e-8c48-82ddb8106032 req-b408f2c3-0a08-4894-a699-58be32c9e90e tempest-ServerDiagnosticsTest-853880771 tempest-ServerDiagnosticsTest-853880771-project-member] Enqueued Resource ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec with Priority: HIGHEST for action security_group_members [ 720.400147] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec with Priority: HIGHEST for action security_group_members [ 720.400557] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f930f78-bc74-4f34-9558-0ffb6faee5ec taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.400684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.400752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.400960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.401145] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.401279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.401326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.401445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.401535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.401631] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f930f78-bc74-4f34-9558-0ffb6faee5ec',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.408168] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.408323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.408394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.408610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.408763] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.408862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.408926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.409091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.409175] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.409261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.409351] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.687168] env[67003]: INFO networking_nsxv3.common.synchronization [req-d18e064f-dd17-401e-8c7d-faa207cf9174 req-319efc3b-92d1-487b-b84e-2c3e493bf977 tempest-ServerDiskConfigTestJSON-448903628 tempest-ServerDiskConfigTestJSON-448903628-project-member] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 720.688499] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 720.688963] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.689158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.689259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.689547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.689830] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.689926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.690012] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.690629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.690930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.691263] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.885323] env[67003]: INFO networking_nsxv3.common.synchronization [None req-1b535f8c-4e75-4bae-8f08-b4ff68a3d46f None None] Enqueued Resource ID: fbe958ef-84c8-4043-8596-a3509f30c7e7 with Priority: HIGHEST for action port [ 720.885785] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbe958ef-84c8-4043-8596-a3509f30c7e7 with Priority: HIGHEST for action port [ 720.887205] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbe958ef-84c8-4043-8596-a3509f30c7e7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.887435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbe958ef-84c8-4043-8596-a3509f30c7e7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.887435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbe958ef-84c8-4043-8596-a3509f30c7e7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.888028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbe958ef-84c8-4043-8596-a3509f30c7e7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.888028] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbe958ef-84c8-4043-8596-a3509f30c7e7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.903352] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.903512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.903581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.903802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.903944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.904108] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.904202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.904261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.904407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.904479] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.904560] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec is going to be updated. [ 720.911368] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.911543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.911584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.911769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.911928] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.912045] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.912108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.912258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.912340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.912439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.912585] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.912674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.912805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.912866] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.913695] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.916644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.916749] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.916943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.917055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.917150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.917247] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.942872] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.943076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.943120] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.943538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.943651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.955041] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec in Status: IN_PROGRESS for 2s [ 721.195389] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.195587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.195694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.195954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.196127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.196391] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.196581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.196666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.197198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.197367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.197487] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 721.251187] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.251368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.251410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.251620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.251776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.261495] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 721.264496] env[67003]: INFO networking_nsxv3.common.synchronization [req-b5e27354-73bf-4d57-84e9-3302102b41ac req-69243e0d-8d49-4a7b-85da-e44cb0780fea tempest-FloatingIPsAssociationTestJSON-1536953296 tempest-FloatingIPsAssociationTestJSON-1536953296-project-member] Enqueued Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_members [ 721.264496] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_members [ 721.265049] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.265192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.265263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.266474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.266474] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.266474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.266474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.266474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.266474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.266474] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.392176] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbe958ef-84c8-4043-8596-a3509f30c7e7 [ 721.392599] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.392599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.392711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.393519] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.393519] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.393519] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbe958ef-84c8-4043-8596-a3509f30c7e7 already deleted. [ 721.393519] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbe958ef-84c8-4043-8596-a3509f30c7e7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.423956] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7a631474-f774-4747-8676-6477b61cae29: rpc.has_security_group_logging(os_id): False [ 721.453246] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.453451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.453789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.453789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.453944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.454170] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.454288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.457851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.457851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.457851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.457851] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.457851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.457851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.457851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.457851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.457851] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.457851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.457851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.457851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.457851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.457851] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 721.527849] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.527849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.528201] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.528427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.528592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.549644] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 721.772570] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.833521] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-389 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.833696] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-389" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.833841] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-389" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.834201] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-389" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.834576] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.834782] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.834854] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.835109] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.835286] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.835495] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.835609] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 721.835723] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 721.835863] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 721.836298] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 721.840033] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 721.840033] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 721.861610] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 721.861793] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 721.862048] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 721.862218] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-389" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.864043] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-d75018f4-573d-45ad-a87f-cd16157710a9 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.864043] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-d75018f4-573d-45ad-a87f-cd16157710a9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.864043] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-d75018f4-573d-45ad-a87f-cd16157710a9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.864043] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-d75018f4-573d-45ad-a87f-cd16157710a9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.864043] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d75018f4-573d-45ad-a87f-cd16157710a9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.875329] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e in Status: SUCCESS [ 721.875561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.876216] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.876705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.876705] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.876811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.876946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.880026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.880026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.880026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.880026] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5e34b189-aa15-4302-9a41-1a1ce1edfa1e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.283507] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.366968] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.367234] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.367357] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.367656] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.367945] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.368030] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port d75018f4-573d-45ad-a87f-cd16157710a9 not found, creating... [ 722.368357] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.368534] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.368665] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.368917] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.369139] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.369491] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.369619] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.369742] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.369978] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.370152] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.370309] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: d75018f4-573d-45ad-a87f-cd16157710a9 is going to be created. [ 722.380421] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.380544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.380633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.380860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.381133] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.381279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.381392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.381642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.381743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.381880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.382070] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.382178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.382217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.382358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.382506] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.382613] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.382678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.382821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.382903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.382990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.383516] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5e34b189-aa15-4302-9a41-1a1ce1edfa1e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.399520] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.399988] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.399988] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.400428] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.400493] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.400757] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-d75018f4-573d-45ad-a87f-cd16157710a9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.785411] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.785740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.785864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.786345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.786345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.786499] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d is going to be updated. [ 722.826286] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.827682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.827958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.828335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.830019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.844027] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: IN_PROGRESS for 2s [ 722.885916] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5e34b189-aa15-4302-9a41-1a1ce1edfa1e: rpc.has_security_group_logging(os_id): False [ 722.904421] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.904614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.904689] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.904923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.905081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.905321] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.905518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.905518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.905694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.905847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.905985] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.906086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.906231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.906311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.906422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.906588] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.906685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.906747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.906885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.907018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.907112] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e is going to be created. [ 722.965156] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec in Status: SUCCESS [ 722.965328] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec deletion is rescheduled due to dependency. [ 722.965457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.003211] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.003366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.003366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.003578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.003760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.017275] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e in Status: IN_PROGRESS for 2s [ 723.113194] env[67003]: INFO networking_nsxv3.common.synchronization [None req-b00c26d8-cdb4-4f60-bd55-a36d2a8f750b tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_rules [ 723.113966] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_rules [ 723.114490] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.114653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.114741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.115155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.115293] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.128496] env[67003]: INFO networking_nsxv3.common.synchronization [req-b5e27354-73bf-4d57-84e9-3302102b41ac req-b6072552-79af-4f31-b110-8503055bad03 service nova] Enqueued Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_rules [ 723.128496] env[67003]: INFO networking_nsxv3.common.synchronization [req-b5e27354-73bf-4d57-84e9-3302102b41ac req-b6072552-79af-4f31-b110-8503055bad03 service nova] Enqueued Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_members [ 723.128496] env[67003]: INFO networking_nsxv3.common.synchronization [req-b5e27354-73bf-4d57-84e9-3302102b41ac req-b6072552-79af-4f31-b110-8503055bad03 service nova] Enqueued Resource ID: d75018f4-573d-45ad-a87f-cd16157710a9 with Priority: HIGHEST for action port [ 723.128496] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_rules [ 723.128496] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_members [ 723.128496] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d75018f4-573d-45ad-a87f-cd16157710a9 with Priority: HIGHEST for action port [ 723.130035] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.130544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.132175] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.132175] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.132175] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.133198] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.133298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.135381] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d75018f4-573d-45ad-a87f-cd16157710a9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.135381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d75018f4-573d-45ad-a87f-cd16157710a9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.135381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d75018f4-573d-45ad-a87f-cd16157710a9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.135381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d75018f4-573d-45ad-a87f-cd16157710a9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.135381] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d75018f4-573d-45ad-a87f-cd16157710a9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.246642] env[67003]: INFO networking_nsxv3.common.synchronization [None req-9195719f-284b-422a-b449-dfc84597cd68 tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_rules [ 723.246642] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_rules [ 723.246642] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.246642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.273467] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 723.273651] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 deletion is rescheduled due to dependency. [ 723.273759] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.571937] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 723.572320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.637050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.637050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.637418] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d75018f4-573d-45ad-a87f-cd16157710a9 with status ACTIVE [ 723.637472] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.637916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.638029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.638235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.638331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.638554] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.638664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.638782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.639065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.639065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.639206] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.639298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.639359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.639603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.639603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.639803] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d75018f4-573d-45ad-a87f-cd16157710a9 is going to be updated. [ 723.651197] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.651197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.651530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.651530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.651618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.651779] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc already deleted. [ 723.652048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.652688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.652960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.653073] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.672917] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.673188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.673394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.673558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.673798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.674097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d75018f4-573d-45ad-a87f-cd16157710a9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.081023] env[67003]: INFO networking_nsxv3.common.synchronization [None req-10cc7b35-ac1e-4a8b-b40c-dfa65210a10c None None] Enqueued Resource ID: 654a8ffa-318b-4dab-90ec-74bd6c66caa2 with Priority: HIGHEST for action port [ 724.081023] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 654a8ffa-318b-4dab-90ec-74bd6c66caa2 with Priority: HIGHEST for action port [ 724.081023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-654a8ffa-318b-4dab-90ec-74bd6c66caa2 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.081023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-654a8ffa-318b-4dab-90ec-74bd6c66caa2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.081023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-654a8ffa-318b-4dab-90ec-74bd6c66caa2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.081903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-654a8ffa-318b-4dab-90ec-74bd6c66caa2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.083746] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('654a8ffa-318b-4dab-90ec-74bd6c66caa2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.177460] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.177999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.177999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.178148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.178231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.181024] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc already deleted. [ 724.181024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.567610] env[67003]: INFO networking_nsxv3.common.synchronization [req-540900f1-da4d-445a-acc2-5da681a271fe req-f5e73bf6-0cdc-46c5-94eb-a4596d98408b tempest-SecurityGroupRulesTestJSON-1633668150 tempest-SecurityGroupRulesTestJSON-1633668150-project-member] Enqueued Resource ID: 086f67db-6123-483f-b441-d67294fd1223 with Priority: HIGHEST for action security_group_rules [ 724.567610] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 086f67db-6123-483f-b441-d67294fd1223 with Priority: HIGHEST for action security_group_rules [ 724.567610] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-086f67db-6123-483f-b441-d67294fd1223 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.567610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-086f67db-6123-483f-b441-d67294fd1223" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.567610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-086f67db-6123-483f-b441-d67294fd1223" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.567610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-086f67db-6123-483f-b441-d67294fd1223" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.567610] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('086f67db-6123-483f-b441-d67294fd1223',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.585213] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 654a8ffa-318b-4dab-90ec-74bd6c66caa2 [ 724.585496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.585588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.585624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.587022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.587022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.587022] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:654a8ffa-318b-4dab-90ec-74bd6c66caa2 already deleted. [ 724.587022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-654a8ffa-318b-4dab-90ec-74bd6c66caa2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.854436] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: SUCCESS [ 724.854436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.854436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.854436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.854833] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.854833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.854833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.855107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.855107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.855211] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.038790] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e in Status: SUCCESS [ 725.038790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.106730] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.106938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.106938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.107274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.107425] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.107567] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 086f67db-6123-483f-b441-d67294fd1223 already deleted. [ 725.107738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-086f67db-6123-483f-b441-d67294fd1223" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.358977] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.862639] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.369080] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.369080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.369080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.369080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.369080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.369080] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d is going to be updated. [ 726.405214] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.405506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.405506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.406735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.406735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.422380] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: IN_PROGRESS for 2s [ 726.586724] env[67003]: INFO networking_nsxv3.common.synchronization [req-462f94a9-f9dc-46f1-b644-c4ecaa85ae46 req-772f7563-04e7-4693-92a0-80d82c43bed8 tempest-ServersTestMultiNic-1026664683 tempest-ServersTestMultiNic-1026664683-project-member] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 726.587350] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 726.587667] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.587853] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.587926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.588682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.588682] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.588837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.588881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.589118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.589264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.589375] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.993156] env[67003]: INFO networking_nsxv3.common.synchronization [req-462f94a9-f9dc-46f1-b644-c4ecaa85ae46 req-72b0e5b6-116a-41a6-a627-fd4e3b9d5f49 tempest-ServersTestMultiNic-1026664683 tempest-ServersTestMultiNic-1026664683-project-member] Enqueued Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 726.993156] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7a631474-f774-4747-8676-6477b61cae29 with Priority: HIGHEST for action security_group_members [ 726.993156] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-7a631474-f774-4747-8676-6477b61cae29 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.993717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.092826] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.503165] env[67003]: INFO networking_nsxv3.common.synchronization [req-bfde100d-5d3b-4511-85bc-d902ffb24c93 req-af5bf404-2c41-4ae7-a858-0d0cf93e902e tempest-SecurityGroupRulesTestJSON-1633668150 tempest-SecurityGroupRulesTestJSON-1633668150-project-member] Enqueued Resource ID: 3d2e9aaf-647e-43f3-be5a-bc5def13a9b2 with Priority: HIGHEST for action security_group_rules [ 727.503710] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d2e9aaf-647e-43f3-be5a-bc5def13a9b2 with Priority: HIGHEST for action security_group_rules [ 727.504401] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3d2e9aaf-647e-43f3-be5a-bc5def13a9b2 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.504552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3d2e9aaf-647e-43f3-be5a-bc5def13a9b2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.504604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3d2e9aaf-647e-43f3-be5a-bc5def13a9b2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.504840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3d2e9aaf-647e-43f3-be5a-bc5def13a9b2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.505012] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3d2e9aaf-647e-43f3-be5a-bc5def13a9b2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.596433] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.026987] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.028329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.028329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.028329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.028329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.028329] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3d2e9aaf-647e-43f3-be5a-bc5def13a9b2 already deleted. [ 728.028329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3d2e9aaf-647e-43f3-be5a-bc5def13a9b2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.100877] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.101059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.101224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.101426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.101512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.101607] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 728.133321] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.133517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.133552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.133793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.133889] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.146174] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 728.435275] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: SUCCESS [ 728.435692] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.435897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.436185] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.436429] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.436557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.436640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.436849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.436961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.437191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.437351] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.513897] env[67003]: INFO networking_nsxv3.common.synchronization [None req-903eb548-5a23-495a-bf70-4d73d59754ac tempest-ImagesOneServerNegativeTestJSON-533995407 tempest-ImagesOneServerNegativeTestJSON-533995407-project-member] Enqueued Resource ID: 0baa188f-994c-4e25-99d7-d9c73be1f6bf with Priority: HIGHEST for action security_group_rules [ 728.513897] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0baa188f-994c-4e25-99d7-d9c73be1f6bf with Priority: HIGHEST for action security_group_rules [ 728.516050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0baa188f-994c-4e25-99d7-d9c73be1f6bf taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.516050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0baa188f-994c-4e25-99d7-d9c73be1f6bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.516050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0baa188f-994c-4e25-99d7-d9c73be1f6bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.516050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0baa188f-994c-4e25-99d7-d9c73be1f6bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.516050] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0baa188f-994c-4e25-99d7-d9c73be1f6bf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.606029] env[67003]: INFO networking_nsxv3.common.synchronization [None req-cf5c95f0-b302-4a0f-8175-28660d7d6cc8 tempest-ImagesOneServerNegativeTestJSON-533995407 tempest-ImagesOneServerNegativeTestJSON-533995407-project-member] Enqueued Resource ID: 0baa188f-994c-4e25-99d7-d9c73be1f6bf with Priority: HIGHEST for action security_group_rules [ 728.608353] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0baa188f-994c-4e25-99d7-d9c73be1f6bf with Priority: HIGHEST for action security_group_rules [ 728.608353] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0baa188f-994c-4e25-99d7-d9c73be1f6bf taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.608353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0baa188f-994c-4e25-99d7-d9c73be1f6bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.940259] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.940608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.940608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.940816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.941057] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.941195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.941313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.941511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.941559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.941640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.942099] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.942099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.942099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.942234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.942397] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.942523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.942588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.942738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.942822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.942909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.942996] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.039065] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.039380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.039380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.040611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.040724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.041234] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0baa188f-994c-4e25-99d7-d9c73be1f6bf already deleted. [ 729.041374] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0baa188f-994c-4e25-99d7-d9c73be1f6bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.041650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0baa188f-994c-4e25-99d7-d9c73be1f6bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.044092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0baa188f-994c-4e25-99d7-d9c73be1f6bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.044092] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0baa188f-994c-4e25-99d7-d9c73be1f6bf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.452057] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e316a4c0-3a83-4827-a5c7-8cc4a342b65d: rpc.has_security_group_logging(os_id): False [ 729.476521] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.476690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.476732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.476940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.477116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.477434] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.477538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.477609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.477807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.477893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.478098] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.478201] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.478263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.479050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.479176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.483459] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.483686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.483779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.484058] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.484180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.484323] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d is going to be updated. [ 729.571402] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.571593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.571688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.572056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.572176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.572279] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0baa188f-994c-4e25-99d7-d9c73be1f6bf already deleted. [ 729.572366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0baa188f-994c-4e25-99d7-d9c73be1f6bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.582558] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.582782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.582876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.583138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.583308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.601909] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: IN_PROGRESS for 2s [ 729.970137] env[67003]: INFO networking_nsxv3.common.synchronization [req-cedbb132-1c07-41f3-ad3a-ee6c90affba5 req-6c9754f5-199d-441e-940e-ce4ffd99d629 tempest-ImagesTestJSON-830230457 tempest-ImagesTestJSON-830230457-project-member] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 729.970737] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 729.973372] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.973621] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.973697] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.977032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.977032] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.977032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.977032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.977032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.977032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.977032] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.156478] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 730.156882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.156882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.157121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.157299] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.157442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.157533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.157630] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.157701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.157793] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7a631474-f774-4747-8676-6477b61cae29',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.480028] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.480332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.480332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.481107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.481107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.481644] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.481644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.481644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.481791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.481830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.481898] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 730.521651] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.521651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.521651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.521651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.521651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.533324] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 730.660064] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.660274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.660274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.660791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.660791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.660791] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.660959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.660959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.661055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.661157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.661211] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 is going to be updated. [ 730.692353] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.692621] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.692698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.693038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.693184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.705449] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: IN_PROGRESS for 2s [ 731.618345] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: SUCCESS [ 731.618902] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.653659] env[67003]: INFO networking_nsxv3.common.synchronization [req-ce6972dd-df14-49f0-b052-868082bfd1fe req-df014b6c-202b-472e-8b78-85934565922c tempest-SecurityGroupRulesTestJSON-1633668150 tempest-SecurityGroupRulesTestJSON-1633668150-project-member] Enqueued Resource ID: 60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7 with Priority: HIGHEST for action security_group_rules [ 731.655794] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7 with Priority: HIGHEST for action security_group_rules [ 731.656122] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.656219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.656282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.656551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.656657] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.181394] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.181561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.181639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.181907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.182034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.182148] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7 already deleted. [ 732.182237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.408932] env[67003]: INFO networking_nsxv3.common.synchronization [req-f088081d-0a3e-4e3b-95ea-fbe4743f2506 req-4b01105f-9bfb-40ef-9df3-380535273d55 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 732.410186] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 732.410557] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.410723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.410787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.411059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.411219] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.411322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.411372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.411520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.411606] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.411696] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.551527] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 732.551884] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 deletion is rescheduled due to dependency. [ 732.552105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.720198] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7a631474-f774-4747-8676-6477b61cae29 in Status: SUCCESS [ 732.720686] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7a631474-f774-4747-8676-6477b61cae29 deletion is rescheduled due to dependency. [ 732.720929] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7a631474-f774-4747-8676-6477b61cae29" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.797652] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.797854] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.797975] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.798279] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.798513] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.798664] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.798775] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.799014] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.799176] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.799378] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.799484] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.799662] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.799747] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.799784] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.799884] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.800037] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.822972] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.823267] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.823490] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.823753] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.824247] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-67f4416a-d587-4038-9778-088a3b46f1fe taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.824594] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-67f4416a-d587-4038-9778-088a3b46f1fe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.824746] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-67f4416a-d587-4038-9778-088a3b46f1fe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.825146] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-67f4416a-d587-4038-9778-088a3b46f1fe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.825435] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67f4416a-d587-4038-9778-088a3b46f1fe',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.916639] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.916639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.916639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.916639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.916639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.916639] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.916639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.916639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.916639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.916639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.916639] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a already deleted. [ 732.916639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.330044] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.330044] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.330044] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.330044] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.330044] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.330044] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 67f4416a-d587-4038-9778-088a3b46f1fe not found, creating... [ 733.330044] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.330044] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.330044] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.330044] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.330044] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.330573] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.330573] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.330820] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.331186] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.331431] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.331685] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 67f4416a-d587-4038-9778-088a3b46f1fe is going to be created. [ 733.357455] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.357455] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.357455] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.357455] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.357455] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.357455] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-67f4416a-d587-4038-9778-088a3b46f1fe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.119611] env[67003]: INFO networking_nsxv3.common.synchronization [req-f088081d-0a3e-4e3b-95ea-fbe4743f2506 req-95854856-249a-42b8-9966-5b004fd75ff5 service nova] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_rules [ 734.119867] env[67003]: INFO networking_nsxv3.common.synchronization [req-f088081d-0a3e-4e3b-95ea-fbe4743f2506 req-95854856-249a-42b8-9966-5b004fd75ff5 service nova] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 734.120017] env[67003]: INFO networking_nsxv3.common.synchronization [req-f088081d-0a3e-4e3b-95ea-fbe4743f2506 req-95854856-249a-42b8-9966-5b004fd75ff5 service nova] Enqueued Resource ID: 67f4416a-d587-4038-9778-088a3b46f1fe with Priority: HIGHEST for action port [ 734.121305] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_rules [ 734.121467] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 734.122020] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67f4416a-d587-4038-9778-088a3b46f1fe with Priority: HIGHEST for action port [ 734.123037] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.123181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.123267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.123553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.123646] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.124596] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.124744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.124811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.125014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.125412] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.125540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.125607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.125797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.125893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.126088] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.127697] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-67f4416a-d587-4038-9778-088a3b46f1fe taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.127795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67f4416a-d587-4038-9778-088a3b46f1fe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.127875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67f4416a-d587-4038-9778-088a3b46f1fe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.128092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67f4416a-d587-4038-9778-088a3b46f1fe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.128201] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67f4416a-d587-4038-9778-088a3b46f1fe',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.630940] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.635027] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.635027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.635027] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 67f4416a-d587-4038-9778-088a3b46f1fe with status ACTIVE [ 734.635027] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.635027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.635027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.635027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.635027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.635027] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.635027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.635027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.635027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.635027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.635027] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.635537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.635537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.636238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.636706] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.636706] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 67f4416a-d587-4038-9778-088a3b46f1fe is going to be updated. [ 734.674424] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.676037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.676037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.676037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.676037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.676037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67f4416a-d587-4038-9778-088a3b46f1fe" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.941185] env[67003]: INFO networking_nsxv3.common.synchronization [req-dcbd68b2-4b7e-4031-b7d1-3b2fb3cd7ef0 req-4b118058-dcc6-4938-8fcf-1866f67a6151 tempest-ServersAdminNegativeTestJSON-1891119767 tempest-ServersAdminNegativeTestJSON-1891119767-project-member] Enqueued Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_members [ 734.942405] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_members [ 734.942405] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.942405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.942599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.942713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.942879] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.942981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.943058] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.943219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.943307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.943989] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.139310] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.359535] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.359780] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.359935] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.360274] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.360653] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.360864] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.361423] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.361423] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.361423] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.361715] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.361905] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 735.361905] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 735.362036] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 735.362288] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 735.362385] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 735.362619] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 735.413896] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 735.414156] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 735.414330] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 735.414517] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.414905] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-93337214-5f46-40ba-a3b2-d317470cd484 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.415183] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-93337214-5f46-40ba-a3b2-d317470cd484" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.415334] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-93337214-5f46-40ba-a3b2-d317470cd484" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.416530] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-93337214-5f46-40ba-a3b2-d317470cd484" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.416903] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93337214-5f46-40ba-a3b2-d317470cd484',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.447228] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.447228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.447228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.447228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.447228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.447228] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.447228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.447228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.447228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.447228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.447228] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc already deleted. [ 735.447228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.643184] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.643184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.643184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.643184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.643184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.643184] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be created. [ 735.671012] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.671176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.672114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.672414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.672595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.689512] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: UNINITIALIZED for 2s [ 735.919507] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.919770] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.919896] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.920290] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.920540] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.920776] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 93337214-5f46-40ba-a3b2-d317470cd484 not found, creating... [ 735.921073] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.921242] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.921354] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.921694] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.921752] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.922025] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.924868] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.925076] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.925463] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.925598] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.925742] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 93337214-5f46-40ba-a3b2-d317470cd484 is going to be created. [ 735.949362] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.949566] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.949686] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.949944] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.950224] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.950456] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-93337214-5f46-40ba-a3b2-d317470cd484" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.627262] env[67003]: INFO networking_nsxv3.common.synchronization [req-e7aafde1-cc09-46ea-8062-c8944042f576 req-8753bf8f-aae2-432f-ae0b-d881d06e31f6 tempest-SecurityGroupRulesTestJSON-1633668150 tempest-SecurityGroupRulesTestJSON-1633668150-project-member] Enqueued Resource ID: 60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7 with Priority: HIGHEST for action security_group_rules [ 736.628265] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7 with Priority: HIGHEST for action security_group_rules [ 736.628671] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.628671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.629068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.629068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.629368] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.697332] env[67003]: INFO networking_nsxv3.common.synchronization [req-dcbd68b2-4b7e-4031-b7d1-3b2fb3cd7ef0 req-96df6ec9-0415-4ea2-ae92-55cdb2d6561f service nova] Enqueued Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_rules [ 736.697485] env[67003]: INFO networking_nsxv3.common.synchronization [req-dcbd68b2-4b7e-4031-b7d1-3b2fb3cd7ef0 req-96df6ec9-0415-4ea2-ae92-55cdb2d6561f service nova] Enqueued Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_members [ 736.697684] env[67003]: INFO networking_nsxv3.common.synchronization [req-dcbd68b2-4b7e-4031-b7d1-3b2fb3cd7ef0 req-96df6ec9-0415-4ea2-ae92-55cdb2d6561f service nova] Enqueued Resource ID: 93337214-5f46-40ba-a3b2-d317470cd484 with Priority: HIGHEST for action port [ 736.698585] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_rules [ 736.698754] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_members [ 736.698903] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93337214-5f46-40ba-a3b2-d317470cd484 with Priority: HIGHEST for action port [ 736.699841] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.699841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.699841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.700345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.700345] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.701862] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.702197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.702197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.702309] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.702541] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.702638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.702704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.702882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.702944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.703027] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.704461] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-93337214-5f46-40ba-a3b2-d317470cd484 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.704579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93337214-5f46-40ba-a3b2-d317470cd484" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.704702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93337214-5f46-40ba-a3b2-d317470cd484" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.705095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93337214-5f46-40ba-a3b2-d317470cd484" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.705264] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93337214-5f46-40ba-a3b2-d317470cd484',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.159851] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.160042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.160133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.160325] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.160849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.160849] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7 already deleted. [ 737.160849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.196486] env[67003]: INFO networking_nsxv3.common.synchronization [None req-dd440c43-eb5f-46f1-8633-057f5b573ea6 None None] Enqueued Resource ID: 5e950b55-a659-4c96-bbec-dd12d92f17aa with Priority: HIGHEST for action port [ 737.197173] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e950b55-a659-4c96-bbec-dd12d92f17aa with Priority: HIGHEST for action port [ 737.197577] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e950b55-a659-4c96-bbec-dd12d92f17aa taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.197677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e950b55-a659-4c96-bbec-dd12d92f17aa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.197724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e950b55-a659-4c96-bbec-dd12d92f17aa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.197937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e950b55-a659-4c96-bbec-dd12d92f17aa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.199433] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e950b55-a659-4c96-bbec-dd12d92f17aa',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.207330] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.207499] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.207773] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 93337214-5f46-40ba-a3b2-d317470cd484 with status ACTIVE [ 737.208118] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.208237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.208872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.208872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.208872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.209289] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.210819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.210819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.210819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.210819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.210819] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.210819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.210819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.210819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.211067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.211067] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 93337214-5f46-40ba-a3b2-d317470cd484 is going to be updated. [ 737.212804] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.247481] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.247858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.247858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.248158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.249111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.249111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93337214-5f46-40ba-a3b2-d317470cd484" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.707125] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e950b55-a659-4c96-bbec-dd12d92f17aa [ 737.707125] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.707125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.707125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.707125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.707125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.707125] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e950b55-a659-4c96-bbec-dd12d92f17aa already deleted. [ 737.707125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e950b55-a659-4c96-bbec-dd12d92f17aa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.709835] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 737.710155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.710373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.710768] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.711222] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.711222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.711370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.711519] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.711647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.711761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.712210] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.718839] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.721886] env[67003]: INFO networking_nsxv3.common.synchronization [req-52c7a786-e757-4f08-aeb2-450e65ff311e req-eb6a1459-58f9-4712-abb5-fb30c5311da9 tempest-ServerAddressesTestJSON-1271145558 tempest-ServerAddressesTestJSON-1271145558-project-member] Enqueued Resource ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 with Priority: HIGHEST for action security_group_members [ 737.724240] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 with Priority: HIGHEST for action security_group_members [ 737.724669] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-59de26fa-4c9b-4340-88dc-3e7c276b5c37 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.724866] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.724960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.725348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.725536] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.725715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.725800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.725956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.726079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.726186] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59de26fa-4c9b-4340-88dc-3e7c276b5c37',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.217760] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.217760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.217760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.217760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.217760] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.217760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.217760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.217760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.217760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.217760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.217760] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.217760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.217760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.217760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.217760] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.217760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.218421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.218421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.218421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.218421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.218421] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.225760] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.226098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.229453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.229453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.229453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.229453] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc is going to be created. [ 738.229453] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.229453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.229453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.229453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.229453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.230653] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.230872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.231032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.231347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.231539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.231793] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 already deleted. [ 738.231968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.256787] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.256956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.256994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.257311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.257477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.268292] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: UNINITIALIZED for 2s [ 738.611723] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-281 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.611946] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-281" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.612077] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-281" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.612438] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-281" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.612735] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.612910] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.613056] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.613363] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.613481] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.613694] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.613821] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 738.613895] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 738.614013] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 738.614154] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 738.614259] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 738.614395] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 738.638209] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 738.638407] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 738.638578] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 738.638787] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-281" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.639173] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-5612a247-2cc6-4788-babd-7f9581a9f212 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.639351] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-5612a247-2cc6-4788-babd-7f9581a9f212" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.639512] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-5612a247-2cc6-4788-babd-7f9581a9f212" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.640154] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-5612a247-2cc6-4788-babd-7f9581a9f212" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.640154] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5612a247-2cc6-4788-babd-7f9581a9f212',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.720148] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a: rpc.has_security_group_logging(os_id): False [ 738.743681] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.743870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.745480] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.745480] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.745480] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.745480] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.745480] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.745480] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.745480] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.745480] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.745480] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.746088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.746088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.746088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.746088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.746317] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.746473] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.746568] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.746747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.746866] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.746978] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be created. [ 738.851159] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.851274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.851274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.852570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.852570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.866101] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: IN_PROGRESS for 2s [ 739.145290] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.145290] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.145290] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.145290] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.145290] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.145290] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 5612a247-2cc6-4788-babd-7f9581a9f212 not found, creating... [ 739.145290] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.145290] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.146226] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.146735] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.147273] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.148228] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.148571] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.148954] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.150014] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.150014] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.150014] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 5612a247-2cc6-4788-babd-7f9581a9f212 is going to be created. [ 739.194769] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.194957] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.195123] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.195703] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.196262] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.196592] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-5612a247-2cc6-4788-babd-7f9581a9f212" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.409285] env[67003]: INFO networking_nsxv3.common.synchronization [None req-dc10211a-473c-4640-b3ab-13e0286f950f None None] Enqueued Resource ID: 44a2a584-8b58-49d1-a2ea-43cddb442d8c with Priority: HIGHEST for action port [ 739.409765] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44a2a584-8b58-49d1-a2ea-43cddb442d8c with Priority: HIGHEST for action port [ 739.410096] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-44a2a584-8b58-49d1-a2ea-43cddb442d8c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.410272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44a2a584-8b58-49d1-a2ea-43cddb442d8c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.410322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44a2a584-8b58-49d1-a2ea-43cddb442d8c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.410552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44a2a584-8b58-49d1-a2ea-43cddb442d8c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.410641] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44a2a584-8b58-49d1-a2ea-43cddb442d8c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.913767] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44a2a584-8b58-49d1-a2ea-43cddb442d8c [ 739.914093] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.914189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.914265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.914555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.914675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.914792] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44a2a584-8b58-49d1-a2ea-43cddb442d8c already deleted. [ 739.914883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44a2a584-8b58-49d1-a2ea-43cddb442d8c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.928414] env[67003]: INFO networking_nsxv3.common.synchronization [req-52c7a786-e757-4f08-aeb2-450e65ff311e req-deaf30dd-a1aa-4cd4-9bcf-f162a99f3f06 service nova] Enqueued Resource ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 with Priority: HIGHEST for action security_group_rules [ 739.928581] env[67003]: INFO networking_nsxv3.common.synchronization [req-52c7a786-e757-4f08-aeb2-450e65ff311e req-deaf30dd-a1aa-4cd4-9bcf-f162a99f3f06 service nova] Enqueued Resource ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 with Priority: HIGHEST for action security_group_members [ 739.928714] env[67003]: INFO networking_nsxv3.common.synchronization [req-52c7a786-e757-4f08-aeb2-450e65ff311e req-deaf30dd-a1aa-4cd4-9bcf-f162a99f3f06 service nova] Enqueued Resource ID: 5612a247-2cc6-4788-babd-7f9581a9f212 with Priority: HIGHEST for action port [ 739.929227] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 with Priority: HIGHEST for action security_group_rules [ 739.929394] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 with Priority: HIGHEST for action security_group_members [ 739.929497] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5612a247-2cc6-4788-babd-7f9581a9f212 with Priority: HIGHEST for action port [ 739.929771] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59de26fa-4c9b-4340-88dc-3e7c276b5c37 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.929877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.929945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.931992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.931992] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59de26fa-4c9b-4340-88dc-3e7c276b5c37',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.932553] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-59de26fa-4c9b-4340-88dc-3e7c276b5c37 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.932651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.932763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.933050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.933248] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.933410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.933477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.933701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.933891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.934102] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59de26fa-4c9b-4340-88dc-3e7c276b5c37',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.935612] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-5612a247-2cc6-4788-babd-7f9581a9f212 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.935734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5612a247-2cc6-4788-babd-7f9581a9f212" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.935804] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5612a247-2cc6-4788-babd-7f9581a9f212" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.935967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5612a247-2cc6-4788-babd-7f9581a9f212" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.936065] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5612a247-2cc6-4788-babd-7f9581a9f212',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.284063] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: SUCCESS [ 740.284063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.284291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.284437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.284629] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.284751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.284847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.285121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.285212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.285302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.285393] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.438039] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-59de26fa-4c9b-4340-88dc-3e7c276b5c37 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.438039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.438212] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('59de26fa-4c9b-4340-88dc-3e7c276b5c37',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.440112] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5612a247-2cc6-4788-babd-7f9581a9f212 with status ACTIVE [ 740.440318] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.440447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.440511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.440711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.440801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.440971] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.441080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.441142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.441297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.441377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.441587] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.441728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.441728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.441889] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.441922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.442015] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5612a247-2cc6-4788-babd-7f9581a9f212 is going to be updated. [ 740.480394] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.480577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.480684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.480878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.481055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.481290] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5612a247-2cc6-4788-babd-7f9581a9f212" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.787763] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.787978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.787978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.788223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.788401] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.788528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.788574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.788714] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.788802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.788892] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.789087] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.789224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.789224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.789376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.789497] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.789589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.789652] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.789791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.789872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.789956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.790057] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.879797] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 740.880404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.941488] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('59de26fa-4c9b-4340-88dc-3e7c276b5c37',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.292901] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aecf3eb9-1ca3-4c5d-973b-4e11d36881cc: rpc.has_security_group_logging(os_id): False [ 741.311282] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.311542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.311618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.311838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.311949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.312262] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.312376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.312440] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.312600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.312680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.312859] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.312954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.313050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.313168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.313245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.313427] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.313522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.313579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.313715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.313790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.313874] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc is going to be created. [ 741.383771] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.386021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.386021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.386021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.386021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.403371] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: IN_PROGRESS for 2s [ 741.444178] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.444443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.444547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.444790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.444890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.445043] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 is going to be created. [ 741.480835] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.481103] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.481204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.481395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.481607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.495288] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 in Status: UNINITIALIZED for 2s [ 741.883063] env[67003]: INFO networking_nsxv3.common.synchronization [req-99856c93-b755-4413-b081-1603185c1345 req-ccf78144-15ab-428f-9ed2-366a33251bf5 tempest-SecurityGroupRulesTestJSON-1633668150 tempest-SecurityGroupRulesTestJSON-1633668150-project-member] Enqueued Resource ID: 60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7 with Priority: HIGHEST for action security_group_rules [ 741.883729] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7 with Priority: HIGHEST for action security_group_rules [ 741.884379] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.884530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.884599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.884832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.884970] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.508464] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.509552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.509552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.509770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.509770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.509952] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7 already deleted. [ 742.510064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60257532-2bc0-4eb3-9d5f-d8b8c41b9ca7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.419272] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: SUCCESS [ 743.419581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.507696] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 in Status: SUCCESS [ 743.507940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.508161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.508415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.508604] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.508854] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.508854] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.508969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.509068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.509157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.509249] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('59de26fa-4c9b-4340-88dc-3e7c276b5c37',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.015548] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-59de26fa-4c9b-4340-88dc-3e7c276b5c37 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.017074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.017074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.017074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.017726] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.017948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.018089] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.018377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.018540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.018665] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.018882] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-59de26fa-4c9b-4340-88dc-3e7c276b5c37 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.019607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.019773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.020685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.020685] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.020685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.020685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.020685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.020881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.020881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.020950] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('59de26fa-4c9b-4340-88dc-3e7c276b5c37',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.524040] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 59de26fa-4c9b-4340-88dc-3e7c276b5c37: rpc.has_security_group_logging(os_id): False [ 744.543453] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.543623] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.543685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.543969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.544170] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.544333] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.544459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.544527] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.544700] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.544793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.544969] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.545161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.545161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.545280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.545366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.545589] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.545715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.545778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.546068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.546068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.546391] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 is going to be created. [ 744.629396] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.629575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.629692] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.629849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.630062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.643086] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 in Status: IN_PROGRESS for 2s [ 745.466547] env[67003]: INFO networking_nsxv3.common.synchronization [req-3742a299-b110-4b14-b170-d9bb63760b8d req-bd21d3ba-3ffb-479b-a623-12843ce25922 tempest-ServersWithSpecificFlavorTestJSON-1477718790 tempest-ServersWithSpecificFlavorTestJSON-1477718790-project-member] Enqueued Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_members [ 745.470018] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_members [ 745.470018] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.470018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.470018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.470018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.470018] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.470018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.470018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.470018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.470018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.470018] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.972650] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.972650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.972650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.976418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.976418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.976418] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.976418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.976418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.976418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.976418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.976418] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 is going to be updated. [ 746.009096] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.009235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.009295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.009509] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.009685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.022639] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24c47389-894a-46a4-ac4e-16c5bd995856 in Status: IN_PROGRESS for 2s [ 746.084854] env[67003]: INFO networking_nsxv3.common.synchronization [req-b55fd1e9-660b-4f90-89b3-872dfca04669 req-9c920dfd-8539-4a6c-928b-6dfdfd3da6dd tempest-DeleteServersTestJSON-1342989894 tempest-DeleteServersTestJSON-1342989894-project-member] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 746.084996] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 746.085350] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.085487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.085565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.085868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.086050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.086217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.086263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.086403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.086489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.086586] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.502221] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-521 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.502438] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.502634] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.503087] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.505683] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.506083] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.506451] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.506764] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.506964] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.507260] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.507379] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.507494] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.507678] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.507732] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.507787] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.508037] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.528378] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.528378] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 746.528579] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.528614] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.528926] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-529b745f-e00b-4859-9f0b-26bd35b42aad taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.529114] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-529b745f-e00b-4859-9f0b-26bd35b42aad" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.529239] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-529b745f-e00b-4859-9f0b-26bd35b42aad" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.529547] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-529b745f-e00b-4859-9f0b-26bd35b42aad" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.529684] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('529b745f-e00b-4859-9f0b-26bd35b42aad',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.591687] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.594304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.594452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.594682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.594777] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.595017] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.595155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.595219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.595379] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.595456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.595545] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 already deleted. [ 746.595624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.656328] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 in Status: SUCCESS [ 746.656805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.032603] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.032869] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.032963] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.033368] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.033630] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.033881] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 529b745f-e00b-4859-9f0b-26bd35b42aad not found, creating... [ 747.034389] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.034596] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.034792] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.035290] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.035496] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.035800] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.035959] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.036094] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.036293] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.036481] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.036638] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 529b745f-e00b-4859-9f0b-26bd35b42aad is going to be created. [ 747.060100] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.060321] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.060445] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.060711] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.060934] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.063214] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-529b745f-e00b-4859-9f0b-26bd35b42aad" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.829588] env[67003]: INFO networking_nsxv3.common.synchronization [req-b55fd1e9-660b-4f90-89b3-872dfca04669 req-f4d7a021-8547-48bf-a0ed-56a2702112d3 service nova] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_rules [ 747.829588] env[67003]: INFO networking_nsxv3.common.synchronization [req-b55fd1e9-660b-4f90-89b3-872dfca04669 req-f4d7a021-8547-48bf-a0ed-56a2702112d3 service nova] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 747.829588] env[67003]: INFO networking_nsxv3.common.synchronization [req-b55fd1e9-660b-4f90-89b3-872dfca04669 req-f4d7a021-8547-48bf-a0ed-56a2702112d3 service nova] Enqueued Resource ID: 529b745f-e00b-4859-9f0b-26bd35b42aad with Priority: HIGHEST for action port [ 747.829588] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_rules [ 747.829896] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 747.830165] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529b745f-e00b-4859-9f0b-26bd35b42aad with Priority: HIGHEST for action port [ 747.830917] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.831405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.831598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.831948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.832269] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.833924] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.834279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.834432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.834972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.835315] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.835544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.838027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.838027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.838027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.838027] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.838027] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-529b745f-e00b-4859-9f0b-26bd35b42aad taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.838027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-529b745f-e00b-4859-9f0b-26bd35b42aad" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.838027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-529b745f-e00b-4859-9f0b-26bd35b42aad" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.838027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-529b745f-e00b-4859-9f0b-26bd35b42aad" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.838027] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('529b745f-e00b-4859-9f0b-26bd35b42aad',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.036115] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24c47389-894a-46a4-ac4e-16c5bd995856 in Status: SUCCESS [ 748.036380] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 deletion is rescheduled due to dependency. [ 748.036422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.343064] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.343064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.343064] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 529b745f-e00b-4859-9f0b-26bd35b42aad with status ACTIVE [ 748.343064] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.343064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.343064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.343064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.343064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.343064] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.343064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.343064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.343064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.343064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.343064] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.343691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.343691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.343691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.343691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.343691] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 529b745f-e00b-4859-9f0b-26bd35b42aad is going to be updated. [ 748.344528] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.368361] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.369543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.369543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.369543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.369543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.369543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-529b745f-e00b-4859-9f0b-26bd35b42aad" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.400431] env[67003]: INFO networking_nsxv3.common.synchronization [req-267635b2-cbc7-4fa5-903d-71ba5d70f231 req-27cc766b-c5fe-4363-bd8a-c0e421543a82 tempest-ServerMetadataTestJSON-1836737119 tempest-ServerMetadataTestJSON-1836737119-project-member] Enqueued Resource ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b with Priority: HIGHEST for action security_group_members [ 748.400976] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b with Priority: HIGHEST for action security_group_members [ 748.401619] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.401748] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.401814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.402074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.402250] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.402659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.402659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.402747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.402838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.402933] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('529441da-dfe5-45a5-baf8-e2c1a0fd6f7b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.785227] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-813 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.785430] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-813" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.785542] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-813" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.785853] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-813" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.786471] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.786661] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.786780] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.786998] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.787161] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.787372] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.787483] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 748.787585] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 748.787689] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 748.787796] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 748.787912] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 748.788112] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 748.810607] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 748.810811] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 748.810950] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 748.811133] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-813" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.811444] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-d705d6a3-3958-4ff7-87b6-3f40f12977ec taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.812043] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-d705d6a3-3958-4ff7-87b6-3f40f12977ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.812043] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-d705d6a3-3958-4ff7-87b6-3f40f12977ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.812214] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-d705d6a3-3958-4ff7-87b6-3f40f12977ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.812214] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d705d6a3-3958-4ff7-87b6-3f40f12977ec',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.848965] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.905789] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.906053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.906161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.906395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.906496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.906709] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.907117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.907117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.907117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.907268] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.907268] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b already deleted. [ 748.907551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.314308] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.315567] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.315567] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.315567] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.315567] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.315567] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port d705d6a3-3958-4ff7-87b6-3f40f12977ec not found, creating... [ 749.316192] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.316192] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.316192] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.316192] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.316457] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.316577] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.316759] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.316899] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.317167] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.317334] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.317640] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: d705d6a3-3958-4ff7-87b6-3f40f12977ec is going to be created. [ 749.341082] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.341478] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.341636] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.342032] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.342370] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.342625] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-d705d6a3-3958-4ff7-87b6-3f40f12977ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.354314] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.354314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.354314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.354314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.354314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.354314] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be created. [ 749.412374] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.412520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.412577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.412784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.414552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.443174] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: UNINITIALIZED for 2s [ 750.060308] env[67003]: INFO networking_nsxv3.common.synchronization [req-267635b2-cbc7-4fa5-903d-71ba5d70f231 req-51e18d6b-576e-4aac-a308-fec39cd0cfd8 service nova] Enqueued Resource ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b with Priority: HIGHEST for action security_group_rules [ 750.060498] env[67003]: INFO networking_nsxv3.common.synchronization [req-267635b2-cbc7-4fa5-903d-71ba5d70f231 req-51e18d6b-576e-4aac-a308-fec39cd0cfd8 service nova] Enqueued Resource ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b with Priority: HIGHEST for action security_group_members [ 750.060625] env[67003]: INFO networking_nsxv3.common.synchronization [req-267635b2-cbc7-4fa5-903d-71ba5d70f231 req-51e18d6b-576e-4aac-a308-fec39cd0cfd8 service nova] Enqueued Resource ID: d705d6a3-3958-4ff7-87b6-3f40f12977ec with Priority: HIGHEST for action port [ 750.061509] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b with Priority: HIGHEST for action security_group_rules [ 750.061688] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b with Priority: HIGHEST for action security_group_members [ 750.061785] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d705d6a3-3958-4ff7-87b6-3f40f12977ec with Priority: HIGHEST for action port [ 750.062097] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.062212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.062274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.062615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.062700] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('529441da-dfe5-45a5-baf8-e2c1a0fd6f7b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.063890] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.064032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.064105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.064328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.064456] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.064553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.064611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.064953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.064953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.064953] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('529441da-dfe5-45a5-baf8-e2c1a0fd6f7b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.065794] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d705d6a3-3958-4ff7-87b6-3f40f12977ec taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.065899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d705d6a3-3958-4ff7-87b6-3f40f12977ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.065968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d705d6a3-3958-4ff7-87b6-3f40f12977ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.066131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d705d6a3-3958-4ff7-87b6-3f40f12977ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.066199] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d705d6a3-3958-4ff7-87b6-3f40f12977ec',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.567824] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.568111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.568150] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('529441da-dfe5-45a5-baf8-e2c1a0fd6f7b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 750.569207] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d705d6a3-3958-4ff7-87b6-3f40f12977ec with status ACTIVE [ 750.569372] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.569487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.569604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.569864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.569921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.571083] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.571245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.571289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.571446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.571529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.571780] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.571837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.571992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.572043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.572148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.572247] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d705d6a3-3958-4ff7-87b6-3f40f12977ec is going to be updated. [ 750.594026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.594316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.595034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.595034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.595034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.595034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d705d6a3-3958-4ff7-87b6-3f40f12977ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.077475] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('529441da-dfe5-45a5-baf8-e2c1a0fd6f7b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.463449] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 751.463683] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.463856] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.464104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.464367] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.464507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.464554] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.464720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.464802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.465017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.465115] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.580545] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.580940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.580940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.580940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.581080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.581117] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b is going to be created. [ 751.608654] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.608821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.608821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.609053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.609236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.620554] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b in Status: UNINITIALIZED for 2s [ 751.687371] env[67003]: INFO networking_nsxv3.common.synchronization [req-4cca463f-930a-4c83-9be4-9ec571a73159 req-8649381c-ad8b-4845-b235-feceb20f900e tempest-ServersTestBootFromVolume-709358174 tempest-ServersTestBootFromVolume-709358174-project-member] Enqueued Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGHEST for action security_group_members [ 751.688256] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGHEST for action security_group_members [ 751.688659] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1fb9da3-caa0-493e-935e-25393509c210 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.688822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.688895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.689236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.689548] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.689548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.689657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.689805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.689877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.690073] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1fb9da3-caa0-493e-935e-25393509c210',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.969635] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.969635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.969635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.969635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.969635] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.969635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.969995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.969995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.969995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.970198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.970275] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.970371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.970429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.970570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.970706] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.970793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.970851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.970983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.971086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.971147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.971242] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.092126] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-668 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.093407] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-668" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.093407] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-668" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.093407] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-668" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.093407] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.093407] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.093895] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.093895] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.093895] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.094107] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.094107] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 752.094389] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 752.094434] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 752.094541] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 752.094643] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 752.094774] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 752.117366] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 752.117366] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 752.117366] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 752.117634] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-668" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.118313] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-57881497-3ea4-4829-a480-508e786bd08d taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.118313] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-57881497-3ea4-4829-a480-508e786bd08d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.118313] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-57881497-3ea4-4829-a480-508e786bd08d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.118518] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-57881497-3ea4-4829-a480-508e786bd08d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.118636] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57881497-3ea4-4829-a480-508e786bd08d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.192249] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.192426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.192498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.192804] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.192921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.193132] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.193238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.193325] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.193500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.193540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.193618] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1fb9da3-caa0-493e-935e-25393509c210 already deleted. [ 752.193697] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.475799] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06d182ef-21b7-44fd-8cbf-2f35f7927435: rpc.has_security_group_logging(os_id): False [ 752.496455] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.496789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.496891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.497140] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.497249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.497494] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.497596] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.497657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.497835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.497921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.498207] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.498664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.498664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.498664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.498855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.498900] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.499094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.499094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.499254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.499376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.499509] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be created. [ 752.624117] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.624117] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.624117] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.624117] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.624117] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.624117] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 57881497-3ea4-4829-a480-508e786bd08d not found, creating... [ 752.624874] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.624874] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.624874] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.625034] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.625852] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.625955] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.626182] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.626378] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.626753] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.628430] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.628430] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 57881497-3ea4-4829-a480-508e786bd08d is going to be created. [ 752.652421] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.652421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.652421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.652729] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.653259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.668618] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.669016] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.669202] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.669682] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.670291] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.670520] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-57881497-3ea4-4829-a480-508e786bd08d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.691401] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 753.450681] env[67003]: INFO networking_nsxv3.common.synchronization [req-4cca463f-930a-4c83-9be4-9ec571a73159 req-87573ec2-43d9-4292-b4f0-c0e0ff872afb service nova] Enqueued Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGHEST for action security_group_rules [ 753.450788] env[67003]: INFO networking_nsxv3.common.synchronization [req-4cca463f-930a-4c83-9be4-9ec571a73159 req-87573ec2-43d9-4292-b4f0-c0e0ff872afb service nova] Enqueued Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGHEST for action security_group_members [ 753.450918] env[67003]: INFO networking_nsxv3.common.synchronization [req-4cca463f-930a-4c83-9be4-9ec571a73159 req-87573ec2-43d9-4292-b4f0-c0e0ff872afb service nova] Enqueued Resource ID: 57881497-3ea4-4829-a480-508e786bd08d with Priority: HIGHEST for action port [ 753.451550] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGHEST for action security_group_rules [ 753.451974] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGHEST for action security_group_members [ 753.451974] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57881497-3ea4-4829-a480-508e786bd08d with Priority: HIGHEST for action port [ 753.452278] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1fb9da3-caa0-493e-935e-25393509c210 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.452435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.452482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.452713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.452812] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1fb9da3-caa0-493e-935e-25393509c210',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.453677] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1fb9da3-caa0-493e-935e-25393509c210 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.453834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.453922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.454110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.454776] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.454776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.454776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.454776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.454776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.454776] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1fb9da3-caa0-493e-935e-25393509c210',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.456167] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-57881497-3ea4-4829-a480-508e786bd08d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.456294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57881497-3ea4-4829-a480-508e786bd08d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.456403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57881497-3ea4-4829-a480-508e786bd08d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.457086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57881497-3ea4-4829-a480-508e786bd08d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.457086] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57881497-3ea4-4829-a480-508e786bd08d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.633936] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b in Status: SUCCESS [ 753.636744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.636744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.636744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.636744] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.636744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.636744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.636744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.636744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.636744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.636744] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('529441da-dfe5-45a5-baf8-e2c1a0fd6f7b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.960419] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1fb9da3-caa0-493e-935e-25393509c210',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.961495] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1fb9da3-caa0-493e-935e-25393509c210 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.961661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.961806] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57881497-3ea4-4829-a480-508e786bd08d with status ACTIVE [ 753.961979] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.962166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.962263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.962403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.962493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.962657] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.962757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.962820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.962967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.964411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.964532] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.964646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.964734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.964885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.964967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.965080] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57881497-3ea4-4829-a480-508e786bd08d is going to be updated. [ 753.991808] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.991956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.992081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.992330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.992478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.992680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57881497-3ea4-4829-a480-508e786bd08d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.139171] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.139171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.139171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.139396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.139605] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.139605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.139725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.139767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.140991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.140991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.140991] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.140991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.140991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.140991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.140991] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.140991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.140991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.140991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.140991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.140991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.140991] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('529441da-dfe5-45a5-baf8-e2c1a0fd6f7b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.469489] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1fb9da3-caa0-493e-935e-25393509c210',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.644736] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b: rpc.has_security_group_logging(os_id): False [ 754.665654] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.665881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.665881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.666163] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.666265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.666596] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.666701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.666748] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.666903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.666974] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.667217] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.667324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.667402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.667551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.667627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.667839] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.667938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.668012] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.668246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.668332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.668446] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b is going to be created. [ 754.709187] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 754.709470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.764057] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.764057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.764057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.764057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.764057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.790034] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b in Status: IN_PROGRESS for 2s [ 754.973183] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.973183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.973358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.973635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.973751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.973866] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1fb9da3-caa0-493e-935e-25393509c210 is going to be created. [ 755.006857] env[67003]: INFO networking_nsxv3.common.synchronization [req-48a05d08-54d2-4908-b04f-ee43748433f3 req-966560a1-a20f-44a0-aa61-784fdf4d0789 tempest-ListImageFiltersTestJSON-522016889 tempest-ListImageFiltersTestJSON-522016889-project-member] Enqueued Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_members [ 755.007606] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_members [ 755.007974] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.008890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.008890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.008890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.008890] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.008890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.009125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.009157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.009252] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.009352] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.065159] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.065348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.065400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.065649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.065799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.100395] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1fb9da3-caa0-493e-935e-25393509c210 in Status: UNINITIALIZED for 2s [ 755.462418] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.462650] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.462731] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.462975] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.463283] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.463403] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.463510] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.463724] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.463909] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.467027] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.467027] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 755.467027] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 755.467027] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 755.467027] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 755.467027] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 755.467027] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 755.490592] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 755.490741] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 755.490887] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 755.491081] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.491439] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-c4b4719e-1058-43e1-9528-0c2bdac02060 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.491660] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-c4b4719e-1058-43e1-9528-0c2bdac02060" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.491733] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-c4b4719e-1058-43e1-9528-0c2bdac02060" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.492157] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-c4b4719e-1058-43e1-9528-0c2bdac02060" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.492319] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4b4719e-1058-43e1-9528-0c2bdac02060',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.512872] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.513059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.513168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.513364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.513443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.513646] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.513748] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.513819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.514010] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.514097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.514245] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a already deleted. [ 755.514330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.995830] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.996620] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.996620] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.996620] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.996620] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.996743] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port c4b4719e-1058-43e1-9528-0c2bdac02060 not found, creating... [ 756.001021] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.001021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.001021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.001021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.001021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.001021] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.001021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.001021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.001021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.001021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.001503] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: c4b4719e-1058-43e1-9528-0c2bdac02060 is going to be created. [ 756.023126] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.023711] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.023711] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.023904] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.024140] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.024408] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-c4b4719e-1058-43e1-9528-0c2bdac02060" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.759023] env[67003]: INFO networking_nsxv3.common.synchronization [req-48a05d08-54d2-4908-b04f-ee43748433f3 req-b702504e-ec0e-4578-a414-f1c0c0edcb4f service nova] Enqueued Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_rules [ 756.759023] env[67003]: INFO networking_nsxv3.common.synchronization [req-48a05d08-54d2-4908-b04f-ee43748433f3 req-b702504e-ec0e-4578-a414-f1c0c0edcb4f service nova] Enqueued Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_members [ 756.759023] env[67003]: INFO networking_nsxv3.common.synchronization [req-48a05d08-54d2-4908-b04f-ee43748433f3 req-b702504e-ec0e-4578-a414-f1c0c0edcb4f service nova] Enqueued Resource ID: c4b4719e-1058-43e1-9528-0c2bdac02060 with Priority: HIGHEST for action port [ 756.759023] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_rules [ 756.759023] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_members [ 756.759023] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4b4719e-1058-43e1-9528-0c2bdac02060 with Priority: HIGHEST for action port [ 756.759023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.759023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.759023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.759023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.759023] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.760365] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.760365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.760365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.760604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.761498] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.761498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.761498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.761498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.761498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.761498] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.764091] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4b4719e-1058-43e1-9528-0c2bdac02060 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.764091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4b4719e-1058-43e1-9528-0c2bdac02060" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.764091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4b4719e-1058-43e1-9528-0c2bdac02060" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.764277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4b4719e-1058-43e1-9528-0c2bdac02060" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.764277] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4b4719e-1058-43e1-9528-0c2bdac02060',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.800059] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b in Status: SUCCESS [ 756.800059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.000611] env[67003]: INFO networking_nsxv3.common.synchronization [req-993fc42f-d7b1-4ddf-ba5b-efba6061aa30 req-b931c1a4-0b4d-47be-ac90-f220bcc3032f tempest-FloatingIPsAssociationTestJSON-1536953296 tempest-FloatingIPsAssociationTestJSON-1536953296-project-member] Enqueued Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_members [ 757.001158] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_members [ 757.001477] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.001595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.001678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.001900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.002094] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.002233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.002300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.002458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.002561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.002685] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.112312] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1fb9da3-caa0-493e-935e-25393509c210 in Status: SUCCESS [ 757.112565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.112845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.113096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.113300] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.113430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.113500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.113658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.113741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.113825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.113909] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1fb9da3-caa0-493e-935e-25393509c210',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.267601] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.267969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.268213] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.270344] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4b4719e-1058-43e1-9528-0c2bdac02060 with status ACTIVE [ 757.270580] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.270764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.270862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.271048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.271142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.271340] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.271460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.271537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.271651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.271721] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.271900] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.272053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.275811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.275811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.275811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.275811] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4b4719e-1058-43e1-9528-0c2bdac02060 is going to be updated. [ 757.306789] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.307072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.307072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.310834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.310834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.310834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4b4719e-1058-43e1-9528-0c2bdac02060" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.505987] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.616538] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1fb9da3-caa0-493e-935e-25393509c210',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.777057] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.010042] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.039728] env[67003]: INFO networking_nsxv3.common.synchronization [req-03d43c43-2df6-46c6-9726-7a4c96e9ec07 req-216eee2d-3b33-49c3-ace1-398e10b25dc7 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 758.041263] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 758.041644] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.041773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.041839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.042137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.042284] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.042394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.042460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.043072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.045172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.045172] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.121071] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1fb9da3-caa0-493e-935e-25393509c210: rpc.has_security_group_logging(os_id): False [ 758.140221] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.140221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.140221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.140478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.140478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.140749] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.140885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.140972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.141155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.141336] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.141426] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1fb9da3-caa0-493e-935e-25393509c210 is going to be created. [ 758.222549] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.223659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.223659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.223659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.223659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.240744] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1fb9da3-caa0-493e-935e-25393509c210 in Status: IN_PROGRESS for 2s [ 758.280711] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.280883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.280948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.281205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.282530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.282530] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a is going to be created. [ 758.318128] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.318836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.318836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.319356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.319356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.343779] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: UNINITIALIZED for 2s [ 758.516695] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.517770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.517770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.517770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.517770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.517770] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d is going to be updated. [ 758.554840] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.554840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.554840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.554840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.554840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.554840] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.554840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.554840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.554840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.554840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.554840] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be updated. [ 758.565373] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.565656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.565731] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.566023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.567037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.588203] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: IN_PROGRESS for 2s [ 758.637286] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.637779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.637876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.638242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.638675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.654125] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: IN_PROGRESS for 2s [ 759.425387] env[67003]: INFO networking_nsxv3.common.synchronization [req-70e19c2c-f60f-49a7-b170-f6f8335bd186 req-a6c3f0e0-5452-4ede-bc18-c06d7276ca2d tempest-ServerAddressesTestJSON-1271145558 tempest-ServerAddressesTestJSON-1271145558-project-member] Enqueued Resource ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 with Priority: HIGHEST for action security_group_members [ 759.427465] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 with Priority: HIGHEST for action security_group_members [ 759.427465] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-59de26fa-4c9b-4340-88dc-3e7c276b5c37 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.427465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.427465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.427465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.427465] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.427465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.427465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.427880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.428021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.428131] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('59de26fa-4c9b-4340-88dc-3e7c276b5c37',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.930759] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.931034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.931034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.934324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.934324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.934324] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.934324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.934324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.934324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.934324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.934324] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 is going to be updated. [ 759.975501] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.975648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.975710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.976751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.976751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.988045] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 in Status: IN_PROGRESS for 2s [ 760.253251] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1fb9da3-caa0-493e-935e-25393509c210 in Status: SUCCESS [ 760.253432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.356078] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: SUCCESS [ 760.356827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.356827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.356827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.357026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.357026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.357136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.357235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.357315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.357401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.357494] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.599916] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: SUCCESS [ 760.600239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.665498] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 760.666453] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a deletion is rescheduled due to dependency. [ 760.666453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.859388] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.859539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.859619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.859840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.860027] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.860107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.860168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.860319] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.860401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.860484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.860627] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.860716] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.860773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.860909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.861306] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.861306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.861306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.861451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.861451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.861521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.863885] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.366636] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00a6980b-e22e-4c0a-a83a-f2c84907f57a: rpc.has_security_group_logging(os_id): False [ 761.392640] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.392640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.392640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.392640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.392943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.392943] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.393081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.393081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.393262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.393334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.393576] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.393769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.393769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.393867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.393942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.395047] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.395047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.395047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.395265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.395265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.395376] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a is going to be created. [ 761.494205] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.494425] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.494511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.494736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.494922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.526237] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: IN_PROGRESS for 2s [ 762.000223] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 in Status: SUCCESS [ 762.002090] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 deletion is rescheduled due to dependency. [ 762.002090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.374768] env[67003]: INFO networking_nsxv3.common.synchronization [req-e5a6bc72-8ec6-4d7f-9319-52e35d36283e req-a50710ca-5048-4c2e-9221-0f35f6618a68 tempest-ListImageFiltersTestJSON-522016889 tempest-ListImageFiltersTestJSON-522016889-project-member] Enqueued Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_members [ 762.375411] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_members [ 762.375720] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.375850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.376111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.376475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.376665] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.376773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.376838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.376992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.377094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.377250] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.393943] env[67003]: INFO networking_nsxv3.common.synchronization [req-f4cfbd62-3c68-47f4-a908-079f3b837de2 req-b79b507e-6ae3-4148-af76-2e4acf63a806 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGHEST for action security_group_members [ 762.394398] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGHEST for action security_group_members [ 762.394927] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.395073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.395134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.395500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.395500] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.395622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.395654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.396460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.396460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.396460] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe76f8c3-ada8-43f4-aca9-4d56d251b61c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.447442] env[67003]: INFO networking_nsxv3.common.synchronization [None req-5800c7b9-c283-4122-807c-44e0820bf645 None None] Enqueued Resource ID: 5c72ae06-c0b0-4877-b751-0ee50f001ca5 with Priority: HIGHEST for action port [ 762.448092] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c72ae06-c0b0-4877-b751-0ee50f001ca5 with Priority: HIGHEST for action port [ 762.448571] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c72ae06-c0b0-4877-b751-0ee50f001ca5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.448684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c72ae06-c0b0-4877-b751-0ee50f001ca5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.448684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c72ae06-c0b0-4877-b751-0ee50f001ca5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.448925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c72ae06-c0b0-4877-b751-0ee50f001ca5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.449015] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c72ae06-c0b0-4877-b751-0ee50f001ca5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.880237] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.898720] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.898980] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.898980] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.899203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.899294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.899487] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.899887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.899887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.899887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.899887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.900051] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c is going to be updated. [ 762.933019] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.933987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.933987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.934168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.934365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.946417] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c in Status: IN_PROGRESS for 2s [ 762.951578] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5c72ae06-c0b0-4877-b751-0ee50f001ca5 [ 762.951578] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.952265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.952265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.952265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.952265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.952265] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5c72ae06-c0b0-4877-b751-0ee50f001ca5 already deleted. [ 762.952265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c72ae06-c0b0-4877-b751-0ee50f001ca5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.984877] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.985080] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.985197] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.985463] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.985713] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.985862] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.985972] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.987122] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.987356] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.987568] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.987777] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.987777] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.987891] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.987997] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.988108] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.988234] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 763.009942] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 763.010784] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 763.013018] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 763.013018] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.013018] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-977b72d7-815a-437a-b078-3184387a8891 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.013018] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-977b72d7-815a-437a-b078-3184387a8891" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.013018] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-977b72d7-815a-437a-b078-3184387a8891" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.013018] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-977b72d7-815a-437a-b078-3184387a8891" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.013018] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('977b72d7-815a-437a-b078-3184387a8891',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.384535] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.517013] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.517013] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.517013] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.517013] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.517013] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.517013] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 977b72d7-815a-437a-b078-3184387a8891 not found, creating... [ 763.517013] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.517418] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.517418] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.517504] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.517634] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.517920] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.518073] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.518183] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.518380] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.518506] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.518641] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 977b72d7-815a-437a-b078-3184387a8891 is going to be created. [ 763.545692] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: SUCCESS [ 763.545944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.547517] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.547715] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.547836] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.548482] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.549108] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.550571] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-977b72d7-815a-437a-b078-3184387a8891" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.888333] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.888610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.888610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.889021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.889021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.889021] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a is going to be updated. [ 763.925048] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.925215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.925215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.925433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.925605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.936717] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: IN_PROGRESS for 2s [ 763.994087] env[67003]: INFO networking_nsxv3.common.synchronization [None req-be4e9177-1aeb-49a1-b1ea-4b664ce66b3e None None] Enqueued Resource ID: d2832588-6076-41f7-95ae-b1376c437505 with Priority: HIGHEST for action port [ 763.994761] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2832588-6076-41f7-95ae-b1376c437505 with Priority: HIGHEST for action port [ 763.995801] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d2832588-6076-41f7-95ae-b1376c437505 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.995961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d2832588-6076-41f7-95ae-b1376c437505" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.996087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d2832588-6076-41f7-95ae-b1376c437505" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.996375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d2832588-6076-41f7-95ae-b1376c437505" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.996460] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d2832588-6076-41f7-95ae-b1376c437505',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.106137] env[67003]: INFO networking_nsxv3.common.synchronization [req-066caae9-ab6e-4c74-9794-772682d8998a req-b7ecfd89-0973-4992-8e0d-518957ff0361 tempest-DeleteServersTestJSON-1342989894 tempest-DeleteServersTestJSON-1342989894-project-member] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 764.106667] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 764.106959] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.107104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.107191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.107335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.107487] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.107584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.107651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.107793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.107878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.107973] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.276341] env[67003]: INFO networking_nsxv3.common.synchronization [req-e5a6bc72-8ec6-4d7f-9319-52e35d36283e req-b7ac8e5c-43c2-4dc8-ae05-7ce983d8158e service nova] Enqueued Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_rules [ 764.276511] env[67003]: INFO networking_nsxv3.common.synchronization [req-e5a6bc72-8ec6-4d7f-9319-52e35d36283e req-b7ac8e5c-43c2-4dc8-ae05-7ce983d8158e service nova] Enqueued Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_members [ 764.277369] env[67003]: INFO networking_nsxv3.common.synchronization [req-e5a6bc72-8ec6-4d7f-9319-52e35d36283e req-b7ac8e5c-43c2-4dc8-ae05-7ce983d8158e service nova] Enqueued Resource ID: 977b72d7-815a-437a-b078-3184387a8891 with Priority: HIGHEST for action port [ 764.277369] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_rules [ 764.277369] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_members [ 764.277369] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 977b72d7-815a-437a-b078-3184387a8891 with Priority: HIGHEST for action port [ 764.277618] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.277951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.277951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.277951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.278097] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.278884] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.279054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.279154] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-977b72d7-815a-437a-b078-3184387a8891 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.279254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-977b72d7-815a-437a-b078-3184387a8891" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.279314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-977b72d7-815a-437a-b078-3184387a8891" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.279547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-977b72d7-815a-437a-b078-3184387a8891" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.279547] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('977b72d7-815a-437a-b078-3184387a8891',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.501441] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d2832588-6076-41f7-95ae-b1376c437505 [ 764.501689] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.501897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.501897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.502125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.502225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.502322] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d2832588-6076-41f7-95ae-b1376c437505 already deleted. [ 764.502399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d2832588-6076-41f7-95ae-b1376c437505" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.614084] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.614337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.614413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.614599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.614690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.614889] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.614989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.615064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.615213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.615291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.615393] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 764.687809] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.687809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.687809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.687809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.687809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.696529] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 764.781845] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.782235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.782567] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 977b72d7-815a-437a-b078-3184387a8891 with status ACTIVE [ 764.782896] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.783327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.783517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.783968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.784391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.784869] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.785494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.785639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.786136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.786407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.786906] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.787245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.787455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.787790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.788313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.788561] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 977b72d7-815a-437a-b078-3184387a8891 is going to be updated. [ 764.841733] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.841911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.841911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.842918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.842918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.842918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-977b72d7-815a-437a-b078-3184387a8891" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.965969] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c in Status: SUCCESS [ 764.965969] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c deletion is rescheduled due to dependency. [ 764.965969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.843455] env[67003]: INFO networking_nsxv3.common.synchronization [None req-f5fe8c29-ff83-472f-9fbd-db8f20e2d7ed tempest-ServersTestJSON-1317110385 tempest-ServersTestJSON-1317110385-project-member] Enqueued Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGHEST for action security_group_rules [ 765.844507] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGHEST for action security_group_rules [ 765.844507] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc0841b-286c-4904-bf0d-135e41f2566e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.844507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.844796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.844825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.847237] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc0841b-286c-4904-bf0d-135e41f2566e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.947651] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: SUCCESS [ 765.947814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.949671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.950658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.950658] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.950658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.950658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.950658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.950658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.950929] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.003145] env[67003]: INFO networking_nsxv3.common.synchronization [None req-95191687-6dac-4fc4-a9bc-05eb2bae3518 tempest-ServersTestJSON-1317110385 tempest-ServersTestJSON-1317110385-project-member] Enqueued Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGHEST for action security_group_rules [ 766.003935] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGHEST for action security_group_rules [ 766.004522] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc0841b-286c-4904-bf0d-135e41f2566e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.004787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.047239] env[67003]: INFO networking_nsxv3.common.synchronization [None req-d2fb4fe8-5f65-4361-9d26-1416e044850f None None] Enqueued Resource ID: 6a50bb6f-1b6f-4520-bfe8-64b92a86355f with Priority: HIGHEST for action port [ 766.048630] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a50bb6f-1b6f-4520-bfe8-64b92a86355f with Priority: HIGHEST for action port [ 766.049082] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a50bb6f-1b6f-4520-bfe8-64b92a86355f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.049365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a50bb6f-1b6f-4520-bfe8-64b92a86355f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.049365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a50bb6f-1b6f-4520-bfe8-64b92a86355f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.050687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a50bb6f-1b6f-4520-bfe8-64b92a86355f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.050766] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a50bb6f-1b6f-4520-bfe8-64b92a86355f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.320182] env[67003]: INFO networking_nsxv3.common.synchronization [None req-50d3eb8c-1d92-46fd-bd06-e0c433a062bc tempest-ServersTestManualDisk-372424363 tempest-ServersTestManualDisk-372424363-project-member] Enqueued Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGHEST for action security_group_rules [ 766.321382] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGHEST for action security_group_rules [ 766.321737] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11ed018b-2f29-4f20-913e-d07a9663638e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.321891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.321963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.322381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.322470] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11ed018b-2f29-4f20-913e-d07a9663638e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.370834] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.370834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.370834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.370834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.370834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.370834] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc0841b-286c-4904-bf0d-135e41f2566e already deleted. [ 766.370834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.371100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.371959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.371959] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc0841b-286c-4904-bf0d-135e41f2566e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.454322] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.524394] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ff37f43d-d2bb-4ba4-96c1-9cc1f5d554a3 tempest-ServersTestManualDisk-372424363 tempest-ServersTestManualDisk-372424363-project-member] Enqueued Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGHEST for action security_group_rules [ 766.524456] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGHEST for action security_group_rules [ 766.524734] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11ed018b-2f29-4f20-913e-d07a9663638e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.524835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.554660] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6a50bb6f-1b6f-4520-bfe8-64b92a86355f [ 766.554915] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.555053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.555120] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.555351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.555623] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.555734] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6a50bb6f-1b6f-4520-bfe8-64b92a86355f already deleted. [ 766.555824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a50bb6f-1b6f-4520-bfe8-64b92a86355f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.604088] env[67003]: INFO networking_nsxv3.common.synchronization [None req-f90136d6-19fc-4683-9cbf-fe5a150c541e None None] Enqueued Resource ID: 5f043ead-6851-49f5-8939-e97261290cd9 with Priority: HIGHEST for action port [ 766.604944] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f043ead-6851-49f5-8939-e97261290cd9 with Priority: HIGHEST for action port [ 766.605128] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f043ead-6851-49f5-8939-e97261290cd9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.605216] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f043ead-6851-49f5-8939-e97261290cd9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.605305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f043ead-6851-49f5-8939-e97261290cd9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.605746] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f043ead-6851-49f5-8939-e97261290cd9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.605746] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f043ead-6851-49f5-8939-e97261290cd9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.708533] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 766.709379] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 deletion is rescheduled due to dependency. [ 766.709379] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.853975] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.853975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.854437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.854471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.854629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.854686] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11ed018b-2f29-4f20-913e-d07a9663638e already deleted. [ 766.854740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.854896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.855245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.855385] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11ed018b-2f29-4f20-913e-d07a9663638e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.898770] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.899028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.899028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.900049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.900049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.900049] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc0841b-286c-4904-bf0d-135e41f2566e already deleted. [ 766.900049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.959816] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.111448] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f043ead-6851-49f5-8939-e97261290cd9 [ 767.111448] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.111448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.111448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.111448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.111448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.111699] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f043ead-6851-49f5-8939-e97261290cd9 already deleted. [ 767.111699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f043ead-6851-49f5-8939-e97261290cd9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.380639] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.380811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.381943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.381943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.381943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.381943] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11ed018b-2f29-4f20-913e-d07a9663638e already deleted. [ 767.381943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.461841] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.462100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.462100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.462440] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.462539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.462641] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a is going to be updated. [ 767.497255] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.497411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.497470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.497677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.497845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.509372] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: IN_PROGRESS for 2s [ 769.511206] env[67003]: INFO networking_nsxv3.common.synchronization [req-73ed4c18-e257-4342-ae6a-1705d7370991 req-457cb183-5f22-48b5-90fb-88506b31127b tempest-ServersAdminTestJSON-1432619756 tempest-ServersAdminTestJSON-1432619756-project-member] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 769.512374] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 769.512843] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.513388] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.513388] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.513571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.513811] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.514040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.514184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.514473] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.514656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.514833] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.527150] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: SUCCESS [ 769.529911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.529911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.529911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.529911] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.529911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.529911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.529911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.529911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.529911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.529911] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.955676] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-329 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.956545] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.956718] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.957054] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.957360] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.957949] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.958123] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.958351] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.958526] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.958735] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.958846] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 769.958957] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 769.959133] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 769.959293] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.959452] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 769.959617] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 769.979064] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 769.979241] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 769.979381] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 769.979553] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-329" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.979875] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-94499303-9c6d-49e5-93f6-216fe1c05813 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.980056] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-94499303-9c6d-49e5-93f6-216fe1c05813" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.980174] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-94499303-9c6d-49e5-93f6-216fe1c05813" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.980585] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-94499303-9c6d-49e5-93f6-216fe1c05813" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.981195] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94499303-9c6d-49e5-93f6-216fe1c05813',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.017499] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.032292] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.032488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.032488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.032688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.032949] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.033070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.033135] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.033292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.033377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.033472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.033608] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.033699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.033761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.033900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.034044] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.034133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.034192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.034385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.034468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.034548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.034783] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.483577] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.483796] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.483962] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.484222] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.484432] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.484647] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 94499303-9c6d-49e5-93f6-216fe1c05813 not found, creating... [ 770.484953] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.485126] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.485241] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.485502] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.485664] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.485947] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.486184] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.486303] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.486507] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.486646] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.486795] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 94499303-9c6d-49e5-93f6-216fe1c05813 is going to be created. [ 770.518353] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.518703] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.518741] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.519012] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.519242] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.519463] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-94499303-9c6d-49e5-93f6-216fe1c05813" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.520560] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.537892] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00a6980b-e22e-4c0a-a83a-f2c84907f57a: rpc.has_security_group_logging(os_id): False [ 770.557207] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.557422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.557494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.557711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.557808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.558018] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.558118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.558179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.558526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.558607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.559791] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.559908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.559978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.560193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.560247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.560408] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.560503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.560564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.560704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.560779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.560861] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a is going to be updated. [ 770.652214] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.652214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.652214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.652513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.652513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.690335] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: IN_PROGRESS for 2s [ 771.022977] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.023534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.023534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.023949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.024065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.024182] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 771.060985] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.060985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.060985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.060985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.060985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.070642] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 771.237704] env[67003]: INFO networking_nsxv3.common.synchronization [req-73ed4c18-e257-4342-ae6a-1705d7370991 req-66acad46-200d-49b0-a5d5-9c1ee44b72f2 service nova] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_rules [ 771.237704] env[67003]: INFO networking_nsxv3.common.synchronization [req-73ed4c18-e257-4342-ae6a-1705d7370991 req-66acad46-200d-49b0-a5d5-9c1ee44b72f2 service nova] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 771.237704] env[67003]: INFO networking_nsxv3.common.synchronization [req-73ed4c18-e257-4342-ae6a-1705d7370991 req-66acad46-200d-49b0-a5d5-9c1ee44b72f2 service nova] Enqueued Resource ID: 94499303-9c6d-49e5-93f6-216fe1c05813 with Priority: HIGHEST for action port [ 771.237704] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_rules [ 771.237704] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 771.237704] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94499303-9c6d-49e5-93f6-216fe1c05813 with Priority: HIGHEST for action port [ 771.241021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.241021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.241021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.241296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.241296] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.242464] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.242464] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.242558] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-94499303-9c6d-49e5-93f6-216fe1c05813 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.242665] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94499303-9c6d-49e5-93f6-216fe1c05813" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.242722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94499303-9c6d-49e5-93f6-216fe1c05813" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.242906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94499303-9c6d-49e5-93f6-216fe1c05813" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.242983] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94499303-9c6d-49e5-93f6-216fe1c05813',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.748315] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.748682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.748682] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94499303-9c6d-49e5-93f6-216fe1c05813 with status ACTIVE [ 771.748841] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.748973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.749093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.749305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.749422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.749636] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.749707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.749768] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.749989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.750155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.750364] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.750489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.750543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.750685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.750779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.750952] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94499303-9c6d-49e5-93f6-216fe1c05813 is going to be updated. [ 771.794695] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.795070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.795158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.795468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.795679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.796167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94499303-9c6d-49e5-93f6-216fe1c05813" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.057930] env[67003]: INFO networking_nsxv3.common.synchronization [None req-772c4255-084a-4fe7-89e9-cbcd6b95452d None None] Enqueued Resource ID: 371b8d2a-a249-48f3-a199-faed5610587c with Priority: HIGHEST for action port [ 772.058589] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 371b8d2a-a249-48f3-a199-faed5610587c with Priority: HIGHEST for action port [ 772.058657] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-371b8d2a-a249-48f3-a199-faed5610587c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.059307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-371b8d2a-a249-48f3-a199-faed5610587c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.059307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-371b8d2a-a249-48f3-a199-faed5610587c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.059760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-371b8d2a-a249-48f3-a199-faed5610587c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.059760] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('371b8d2a-a249-48f3-a199-faed5610587c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.562058] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 371b8d2a-a249-48f3-a199-faed5610587c [ 772.562448] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.562597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.562597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.563564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.563564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.563564] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:371b8d2a-a249-48f3-a199-faed5610587c already deleted. [ 772.563564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-371b8d2a-a249-48f3-a199-faed5610587c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.717161] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: SUCCESS [ 772.717414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.086009] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 773.086295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.086432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.086667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.090336] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.094155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.094155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.094155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.094155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.094155] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.594020] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.100428] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.602920] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.603152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.603284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.603442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.603533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.603634] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 774.629825] env[67003]: INFO networking_nsxv3.common.synchronization [None req-67ae0120-d027-4b19-8812-f16a03421e83 None None] Enqueued Resource ID: 91ba326b-37be-4603-b19d-954bf5cc3452 with Priority: HIGHEST for action port [ 774.629825] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91ba326b-37be-4603-b19d-954bf5cc3452 with Priority: HIGHEST for action port [ 774.630069] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-91ba326b-37be-4603-b19d-954bf5cc3452 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.630344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91ba326b-37be-4603-b19d-954bf5cc3452" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.630344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91ba326b-37be-4603-b19d-954bf5cc3452" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.630529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91ba326b-37be-4603-b19d-954bf5cc3452" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.630618] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91ba326b-37be-4603-b19d-954bf5cc3452',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.640601] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.640761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.640831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.641070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.641238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.652432] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 774.918583] env[67003]: INFO networking_nsxv3.common.synchronization [None req-f4acfa89-548e-48e3-9f4c-867d951560b2 tempest-MigrationsAdminTest-779889772 tempest-MigrationsAdminTest-779889772-project-member] Enqueued Resource ID: d46ad2aa-ef0a-4cdf-be70-b501b602a05d with Priority: HIGHEST for action security_group_rules [ 774.919390] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46ad2aa-ef0a-4cdf-be70-b501b602a05d with Priority: HIGHEST for action security_group_rules [ 774.919734] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46ad2aa-ef0a-4cdf-be70-b501b602a05d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.920695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46ad2aa-ef0a-4cdf-be70-b501b602a05d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.920780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46ad2aa-ef0a-4cdf-be70-b501b602a05d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.921352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46ad2aa-ef0a-4cdf-be70-b501b602a05d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.921352] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46ad2aa-ef0a-4cdf-be70-b501b602a05d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.029256] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e128c34a-6684-4090-9f88-2ed3f83d638d tempest-MigrationsAdminTest-779889772 tempest-MigrationsAdminTest-779889772-project-member] Enqueued Resource ID: d46ad2aa-ef0a-4cdf-be70-b501b602a05d with Priority: HIGHEST for action security_group_rules [ 775.029996] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d46ad2aa-ef0a-4cdf-be70-b501b602a05d with Priority: HIGHEST for action security_group_rules [ 775.032454] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d46ad2aa-ef0a-4cdf-be70-b501b602a05d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.032609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d46ad2aa-ef0a-4cdf-be70-b501b602a05d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.134019] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91ba326b-37be-4603-b19d-954bf5cc3452 [ 775.134019] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.134019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.134019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.134019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.134556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.134556] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91ba326b-37be-4603-b19d-954bf5cc3452 already deleted. [ 775.134556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91ba326b-37be-4603-b19d-954bf5cc3452" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.453200] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.453448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.453448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.454214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.454214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.454214] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46ad2aa-ef0a-4cdf-be70-b501b602a05d already deleted. [ 775.454214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46ad2aa-ef0a-4cdf-be70-b501b602a05d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.454577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d46ad2aa-ef0a-4cdf-be70-b501b602a05d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.454790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d46ad2aa-ef0a-4cdf-be70-b501b602a05d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.454881] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d46ad2aa-ef0a-4cdf-be70-b501b602a05d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.976289] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.976444] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.976511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.976726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.976810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.976911] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d46ad2aa-ef0a-4cdf-be70-b501b602a05d already deleted. [ 775.976995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d46ad2aa-ef0a-4cdf-be70-b501b602a05d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.667106] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 776.667481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.667538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.668156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.668156] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.668474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.668474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.668566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.668617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.668763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.668875] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.170986] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.170986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.170986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.171233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.171492] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.171576] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.171624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.171734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.171843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.171978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.172199] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.172320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.172389] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.172559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.172709] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.172800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.172858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.173097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.173149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.173250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.173309] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.423688] env[67003]: INFO networking_nsxv3.common.synchronization [None req-35fe66a5-098e-4f5e-9612-bc3a4935d248 None None] Enqueued Resource ID: 906c938f-ac99-451b-a6fa-6f6ddb5c54b4 with Priority: HIGHEST for action port [ 777.425138] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 906c938f-ac99-451b-a6fa-6f6ddb5c54b4 with Priority: HIGHEST for action port [ 777.427393] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-906c938f-ac99-451b-a6fa-6f6ddb5c54b4 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.427393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-906c938f-ac99-451b-a6fa-6f6ddb5c54b4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.427393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-906c938f-ac99-451b-a6fa-6f6ddb5c54b4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.427393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-906c938f-ac99-451b-a6fa-6f6ddb5c54b4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.427393] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('906c938f-ac99-451b-a6fa-6f6ddb5c54b4',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.679103] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a47e002a-325f-4303-8dea-86209028ebb0: rpc.has_security_group_logging(os_id): False [ 777.700502] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.700661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.700824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.700943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.701042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.701284] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.701395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.701487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.701652] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.701734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.701917] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.702053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.702101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.702235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.702331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.702544] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.702645] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.702710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.702852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.703042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.703146] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 777.786282] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.786522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.786522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.786755] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.786906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.824176] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 777.928425] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 906c938f-ac99-451b-a6fa-6f6ddb5c54b4 [ 777.929034] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.929167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.929167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.929508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.929651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.929766] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:906c938f-ac99-451b-a6fa-6f6ddb5c54b4 already deleted. [ 777.929859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-906c938f-ac99-451b-a6fa-6f6ddb5c54b4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.588992] env[67003]: INFO networking_nsxv3.common.synchronization [req-167ee65c-d5ec-4cd6-b07c-552b0aa20d3a req-f25ff1c6-09de-4ba4-9a39-4ee629f80d2d tempest-ServerMetadataTestJSON-1836737119 tempest-ServerMetadataTestJSON-1836737119-project-member] Enqueued Resource ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b with Priority: HIGHEST for action security_group_members [ 779.589581] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b with Priority: HIGHEST for action security_group_members [ 779.590208] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.591071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.591158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.591503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.591684] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.591786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.591849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.591996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.592122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.592243] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('529441da-dfe5-45a5-baf8-e2c1a0fd6f7b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.846140] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 779.846375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.096458] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.096458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.096458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.098041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.098041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.098041] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.098392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.098392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.098392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.098484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.098512] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b is going to be updated. [ 780.132104] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.132104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.132104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.132449] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.132515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.145398] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b in Status: IN_PROGRESS for 2s [ 780.700047] env[67003]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] NSXv3 Agent Agent loop - iteration:0 completed [ 780.700047] env[67003]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] NSXv3 Agent Agent loop - iteration:1 started [ 781.912066] env[67003]: INFO networking_nsxv3.common.synchronization [req-72c0a184-5a88-4e67-9a59-cdd9d2d807cf req-8b4eb946-f028-4e33-8b56-6ed5f9a413a5 tempest-ServerMetadataNegativeTestJSON-88088149 tempest-ServerMetadataNegativeTestJSON-88088149-project-member] Enqueued Resource ID: d9485466-865a-4183-ac2a-0720f6740f8a with Priority: HIGHEST for action security_group_members [ 781.912673] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9485466-865a-4183-ac2a-0720f6740f8a with Priority: HIGHEST for action security_group_members [ 781.912972] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9485466-865a-4183-ac2a-0720f6740f8a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.913178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.913971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.913971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.913971] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.913971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.913971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.913971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.914299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.914299] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9485466-865a-4183-ac2a-0720f6740f8a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.159359] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b in Status: SUCCESS [ 782.159359] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b deletion is rescheduled due to dependency. [ 782.159359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.279188] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-687 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.279378] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-687" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.279603] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-687" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.279964] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-687" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.280374] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.280599] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.280876] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.281229] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.281459] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.281774] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.281910] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.282033] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.282144] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.282255] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.282378] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.282521] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.302630] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.302796] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 782.302926] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.303130] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-687" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.303490] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-18a8dfef-b3b8-4cfe-822e-7cee368921ac taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.303680] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-18a8dfef-b3b8-4cfe-822e-7cee368921ac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.303749] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-18a8dfef-b3b8-4cfe-822e-7cee368921ac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.304082] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-18a8dfef-b3b8-4cfe-822e-7cee368921ac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.304222] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18a8dfef-b3b8-4cfe-822e-7cee368921ac',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.416883] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.417056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.417132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.417343] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.417434] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.417634] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.417741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.417788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.417938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.418019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.418128] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9485466-865a-4183-ac2a-0720f6740f8a already deleted. [ 782.418214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.810333] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.810333] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.810333] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.810333] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.810333] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.810333] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 18a8dfef-b3b8-4cfe-822e-7cee368921ac not found, creating... [ 782.810333] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.810333] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.810333] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.810333] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.810333] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.811386] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.811775] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.815452] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.815452] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.815452] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.815452] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 18a8dfef-b3b8-4cfe-822e-7cee368921ac is going to be created. [ 782.863904] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.863904] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.863904] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.863904] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.863904] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.863904] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-18a8dfef-b3b8-4cfe-822e-7cee368921ac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.087512] env[67003]: INFO networking_nsxv3.common.synchronization [None req-dec1a75f-3c80-49b5-8cd8-1e129cd5ddbf None None] Enqueued Resource ID: 667afd34-f0b9-4f46-a890-75f2542d2678 with Priority: HIGHEST for action port [ 783.091021] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 667afd34-f0b9-4f46-a890-75f2542d2678 with Priority: HIGHEST for action port [ 783.091021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-667afd34-f0b9-4f46-a890-75f2542d2678 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.091021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-667afd34-f0b9-4f46-a890-75f2542d2678" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.091021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-667afd34-f0b9-4f46-a890-75f2542d2678" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.091021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-667afd34-f0b9-4f46-a890-75f2542d2678" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.091021] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('667afd34-f0b9-4f46-a890-75f2542d2678',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.574705] env[67003]: INFO networking_nsxv3.common.synchronization [req-72c0a184-5a88-4e67-9a59-cdd9d2d807cf req-a4ae9dff-38fe-4b61-bc46-15d1adb3252d service nova] Enqueued Resource ID: d9485466-865a-4183-ac2a-0720f6740f8a with Priority: HIGHEST for action security_group_rules [ 783.576468] env[67003]: INFO networking_nsxv3.common.synchronization [req-72c0a184-5a88-4e67-9a59-cdd9d2d807cf req-a4ae9dff-38fe-4b61-bc46-15d1adb3252d service nova] Enqueued Resource ID: d9485466-865a-4183-ac2a-0720f6740f8a with Priority: HIGHEST for action security_group_members [ 783.576715] env[67003]: INFO networking_nsxv3.common.synchronization [req-72c0a184-5a88-4e67-9a59-cdd9d2d807cf req-a4ae9dff-38fe-4b61-bc46-15d1adb3252d service nova] Enqueued Resource ID: 18a8dfef-b3b8-4cfe-822e-7cee368921ac with Priority: HIGHEST for action port [ 783.577319] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9485466-865a-4183-ac2a-0720f6740f8a with Priority: HIGHEST for action security_group_rules [ 783.577463] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9485466-865a-4183-ac2a-0720f6740f8a with Priority: HIGHEST for action security_group_members [ 783.577800] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18a8dfef-b3b8-4cfe-822e-7cee368921ac with Priority: HIGHEST for action port [ 783.577901] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9485466-865a-4183-ac2a-0720f6740f8a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.578138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.578233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.578560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.578651] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9485466-865a-4183-ac2a-0720f6740f8a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.579540] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9485466-865a-4183-ac2a-0720f6740f8a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.579716] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.579795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.579976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.580157] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.580530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.580858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.580858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.580858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.581066] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9485466-865a-4183-ac2a-0720f6740f8a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.582449] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-18a8dfef-b3b8-4cfe-822e-7cee368921ac taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.582583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18a8dfef-b3b8-4cfe-822e-7cee368921ac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.582583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18a8dfef-b3b8-4cfe-822e-7cee368921ac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.583777] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18a8dfef-b3b8-4cfe-822e-7cee368921ac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.583843] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18a8dfef-b3b8-4cfe-822e-7cee368921ac',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.597646] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 667afd34-f0b9-4f46-a890-75f2542d2678 [ 783.597919] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.598237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.598237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.599168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.599168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.599168] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:667afd34-f0b9-4f46-a890-75f2542d2678 already deleted. [ 783.599168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-667afd34-f0b9-4f46-a890-75f2542d2678" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.015099] env[67003]: INFO networking_nsxv3.common.synchronization [None req-aba7befb-865a-4f78-a689-c304a1bfabec tempest-AttachVolumeShelveTestJSON-97641738 tempest-AttachVolumeShelveTestJSON-97641738-project-member] Enqueued Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_rules [ 784.015651] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_rules [ 784.015852] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.015998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.016078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.016317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.016400] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.087321] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9485466-865a-4183-ac2a-0720f6740f8a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.087460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.087658] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9485466-865a-4183-ac2a-0720f6740f8a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.088656] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18a8dfef-b3b8-4cfe-822e-7cee368921ac with status ACTIVE [ 784.088863] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.088993] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.089083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.089280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.089370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.089545] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.089801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.089801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.089943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.090036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.090232] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.090340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.090426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.090570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.090688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.090720] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18a8dfef-b3b8-4cfe-822e-7cee368921ac is going to be updated. [ 784.117208] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.118145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.118145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.118145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.118145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.118145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18a8dfef-b3b8-4cfe-822e-7cee368921ac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.124280] env[67003]: INFO networking_nsxv3.common.synchronization [None req-23f1e3a5-6676-47a7-8cce-425ca418af05 tempest-AttachVolumeShelveTestJSON-97641738 tempest-AttachVolumeShelveTestJSON-97641738-project-member] Enqueued Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_rules [ 784.124865] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_rules [ 784.125254] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.125339] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.539326] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.539326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.539326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.539570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.539570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.539629] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed already deleted. [ 784.539720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.539851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.540133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.540295] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.592650] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9485466-865a-4183-ac2a-0720f6740f8a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.629916] env[67003]: INFO networking_nsxv3.common.synchronization [req-cc7d3861-cff2-4ff9-a08d-e01920a5adc2 req-566bc456-95a0-4be7-9c2f-286bd8e8c14e tempest-ServerDiskConfigTestJSON-448903628 tempest-ServerDiskConfigTestJSON-448903628-project-member] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 784.630952] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 784.630952] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.631384] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.631384] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.631642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.631827] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.631958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.632618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.632618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.632618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.633064] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.064368] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.064546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.064666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.064835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.065058] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.065120] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed already deleted. [ 785.065264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.078160] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.078411] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.079031] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.079031] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.079339] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.079517] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.079655] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.079895] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.080124] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.080411] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.080541] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 785.080681] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 785.080886] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 785.080959] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 785.081163] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 785.081327] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 785.095471] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.095807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.095807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.095963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.096077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.096190] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9485466-865a-4183-ac2a-0720f6740f8a is going to be created. [ 785.114989] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 785.114989] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.033 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 785.114989] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 785.115222] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.115361] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-27e80055-8b7f-41d2-84fa-b57078392b1e taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.115592] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-27e80055-8b7f-41d2-84fa-b57078392b1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.115732] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-27e80055-8b7f-41d2-84fa-b57078392b1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.116484] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-27e80055-8b7f-41d2-84fa-b57078392b1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.116598] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27e80055-8b7f-41d2-84fa-b57078392b1e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.130521] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.130691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.130805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.131220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.131364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.134664] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.134664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.134664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.134951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.134951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.135250] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.135361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.135361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.135508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.135582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.135674] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 785.145072] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9485466-865a-4183-ac2a-0720f6740f8a in Status: UNINITIALIZED for 2s [ 785.177282] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.177389] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.177506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.177764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.177948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.188556] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 785.621180] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.621418] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.621567] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.621919] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.622266] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.622482] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 27e80055-8b7f-41d2-84fa-b57078392b1e not found, creating... [ 785.622893] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.623108] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.623192] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.623526] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.623655] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.624175] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.624517] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.624705] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.624963] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.625220] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.625395] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 27e80055-8b7f-41d2-84fa-b57078392b1e is going to be created. [ 785.653387] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.653648] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.653791] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.654093] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.654335] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.654640] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-27e80055-8b7f-41d2-84fa-b57078392b1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.983536] env[67003]: INFO networking_nsxv3.common.synchronization [None req-2e3b883e-5e1c-4c74-8013-fc10e9d56b83 None None] Enqueued Resource ID: 46566be9-c2ce-4849-a35c-9c062bc7ea7d with Priority: HIGHEST for action port [ 785.984894] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 46566be9-c2ce-4849-a35c-9c062bc7ea7d with Priority: HIGHEST for action port [ 785.985256] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-46566be9-c2ce-4849-a35c-9c062bc7ea7d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.985904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-46566be9-c2ce-4849-a35c-9c062bc7ea7d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.985904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-46566be9-c2ce-4849-a35c-9c062bc7ea7d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.985904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-46566be9-c2ce-4849-a35c-9c062bc7ea7d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.985904] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('46566be9-c2ce-4849-a35c-9c062bc7ea7d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.389048] env[67003]: INFO networking_nsxv3.common.synchronization [req-cc7d3861-cff2-4ff9-a08d-e01920a5adc2 req-8f8d7387-8ac1-4bcc-9076-9e2dada59e8e service nova] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_rules [ 786.389327] env[67003]: INFO networking_nsxv3.common.synchronization [req-cc7d3861-cff2-4ff9-a08d-e01920a5adc2 req-8f8d7387-8ac1-4bcc-9076-9e2dada59e8e service nova] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 786.389592] env[67003]: INFO networking_nsxv3.common.synchronization [req-cc7d3861-cff2-4ff9-a08d-e01920a5adc2 req-8f8d7387-8ac1-4bcc-9076-9e2dada59e8e service nova] Enqueued Resource ID: 27e80055-8b7f-41d2-84fa-b57078392b1e with Priority: HIGHEST for action port [ 786.390164] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_rules [ 786.390366] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 786.390501] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27e80055-8b7f-41d2-84fa-b57078392b1e with Priority: HIGHEST for action port [ 786.390840] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.391047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.391115] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.391421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.391421] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.392427] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.393082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.393606] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-27e80055-8b7f-41d2-84fa-b57078392b1e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.394247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27e80055-8b7f-41d2-84fa-b57078392b1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.394352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27e80055-8b7f-41d2-84fa-b57078392b1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.394590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27e80055-8b7f-41d2-84fa-b57078392b1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.394700] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27e80055-8b7f-41d2-84fa-b57078392b1e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.489739] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 46566be9-c2ce-4849-a35c-9c062bc7ea7d [ 786.489739] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.490041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.490041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.490462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.490462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.490462] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:46566be9-c2ce-4849-a35c-9c062bc7ea7d already deleted. [ 786.490565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-46566be9-c2ce-4849-a35c-9c062bc7ea7d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.831880] env[67003]: INFO networking_nsxv3.common.synchronization [req-cf1a6a6d-9cc2-4fa9-8b87-793c63c740d1 req-994b161c-4756-4de5-b862-a2d1fca6eb8c tempest-ImagesOneServerTestJSON-1569564112 tempest-ImagesOneServerTestJSON-1569564112-project-member] Enqueued Resource ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e with Priority: HIGHEST for action security_group_members [ 786.832826] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e with Priority: HIGHEST for action security_group_members [ 786.832826] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.832826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.833129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.833129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.833190] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.833294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.833371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.833530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.833615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.833719] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5e34b189-aa15-4302-9a41-1a1ce1edfa1e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.897274] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.897274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.897716] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 27e80055-8b7f-41d2-84fa-b57078392b1e with status ACTIVE [ 786.897951] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.898088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.898159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.898370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.898459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.898640] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.899434] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.899524] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.899705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.899806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.900187] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.900267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.900556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.900556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.900556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.900666] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 27e80055-8b7f-41d2-84fa-b57078392b1e is going to be updated. [ 786.925331] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.925552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.925552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.925787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.925934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.926137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27e80055-8b7f-41d2-84fa-b57078392b1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.158170] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9485466-865a-4183-ac2a-0720f6740f8a in Status: SUCCESS [ 787.158396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.158571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.158821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.159056] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.159266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.159333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.159781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.159781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.159781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.159781] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9485466-865a-4183-ac2a-0720f6740f8a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.202342] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 787.202702] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 deletion is rescheduled due to dependency. [ 787.202836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.203126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.204785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.204785] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.204785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.204785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.204785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.204785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.205037] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.337147] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.337147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.337147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.337147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.337147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.337147] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.337730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.337730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.337730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.337964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.337964] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e is going to be updated. [ 787.371961] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.371961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.371961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.371961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.371961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.382263] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e in Status: IN_PROGRESS for 2s [ 787.662877] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9485466-865a-4183-ac2a-0720f6740f8a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.663198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.663198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.663332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.663507] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.663720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.663720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.663836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.663891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.663983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.664145] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9485466-865a-4183-ac2a-0720f6740f8a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.664238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.664294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.664434] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.664593] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.664685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.664742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.664879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.664954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.665335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.665335] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9485466-865a-4183-ac2a-0720f6740f8a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.708791] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.168292] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9485466-865a-4183-ac2a-0720f6740f8a: rpc.has_security_group_logging(os_id): False [ 788.197052] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.199940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.202790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.202790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.202790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.202790] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.202790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.202790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.202790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.202790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.202790] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.202790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.202790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.202790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.202790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.202790] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.203879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.203879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.203879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.203879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.203879] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9485466-865a-4183-ac2a-0720f6740f8a is going to be created. [ 788.214276] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.270110] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.270273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.270356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.270866] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.271145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.282308] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9485466-865a-4183-ac2a-0720f6740f8a in Status: IN_PROGRESS for 2s [ 788.717221] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.717647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.717647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.717719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.717867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.717997] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 788.752520] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.752699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.752746] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.753042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.753235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.767312] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 789.394830] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e in Status: SUCCESS [ 789.395053] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e deletion is rescheduled due to dependency. [ 789.395147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.294955] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9485466-865a-4183-ac2a-0720f6740f8a in Status: SUCCESS [ 790.295251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.778602] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 790.779384] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.779384] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.779610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.779775] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.779976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.780092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.780344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.780485] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.780648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.780766] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.282951] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.283200] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.283200] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.283427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.283674] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.283793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.283859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.284033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.284110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.284199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.284349] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.284443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.284522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.284680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.284823] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.284918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.284974] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.285123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.285198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.285280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.285367] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.788644] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25f0058d-8729-4623-a291-7d3376597063: rpc.has_security_group_logging(os_id): False [ 791.809440] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.809593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.809637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.809853] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.809946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.810157] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.810259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.810322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.810472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.810568] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.810773] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.810868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.810929] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.811079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.811153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.811357] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.811496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.811571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.811768] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.811809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.811866] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 791.836228] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 791.836228] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 791.883820] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.884728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.884728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.884728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.884903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.898523] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 792.646106] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.646276] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.646355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.646588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.646717] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.154723] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.657258] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.912578] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 793.912812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.160144] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 794.160144] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 794.452290] env[67003]: INFO networking_nsxv3.common.synchronization [req-e92d5f97-4ae7-4924-accf-4230497d3344 req-19f84c06-4eae-43fb-a05c-4b416395ed7a tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_members [ 794.452410] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_members [ 794.453540] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.453540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.453540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.453540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.453540] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.453540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.453540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.453953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.453953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.453953] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.812379] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.812715] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.812866] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.813340] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.813493] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.813763] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.813846] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.814133] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.814312] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.814883] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.817166] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 794.817166] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 794.817166] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 794.817166] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 794.817166] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 794.817166] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 794.840900] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 794.841044] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 794.841262] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 794.841333] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.841876] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-499cea77-3be0-431e-9a7f-9673ed5452bf taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.841876] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-499cea77-3be0-431e-9a7f-9673ed5452bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.842047] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-499cea77-3be0-431e-9a7f-9673ed5452bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.842242] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-499cea77-3be0-431e-9a7f-9673ed5452bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.842385] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('499cea77-3be0-431e-9a7f-9673ed5452bf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.957740] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.957740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.957740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.957740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.957740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.957740] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.957740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.957740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.958090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.958090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.958090] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc already deleted. [ 794.958090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.042804] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.042957] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.043034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.043227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.054172] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 795.055093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.056258] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 795.081219] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.081363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.081363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.081508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.087273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.087756] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 795.087852] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 795.087937] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 795.127661] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.127661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.127661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.127661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.129123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.129123] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 795.196244] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.196244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.196618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.196618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.196743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.196931] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 795.259912] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.260088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.260148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.260391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.260636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.260886] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:33. [ 795.260983] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'096a4cda-6a5e-4383-92c4-166cabe87e96', '24c47389-894a-46a4-ac4e-16c5bd995856', 'fe76f8c3-ada8-43f4-aca9-4d56d251b61c', '187f2eae-7657-4240-8ccd-728badf3526c', '94cc9917-b413-4c1b-9c52-44b1bbb1141a', '43ab13f3-ab08-40ca-8026-84efbca23b63', '33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a', 'c06f8726-ef82-4058-ad8d-7e0aabd079e1', '59de26fa-4c9b-4340-88dc-3e7c276b5c37', 'b4a2c13a-9225-49c6-996f-0d53b89aa94b', '06d182ef-21b7-44fd-8cbf-2f35f7927435', '0984692d-32cd-4b7f-9bd0-7496ca581278', '8df0b4b9-9305-44fa-8ffb-138abad7c0b5', '529441da-dfe5-45a5-baf8-e2c1a0fd6f7b', 'aecf3eb9-1ca3-4c5d-973b-4e11d36881cc', 'd622b8c0-157c-4b92-b9e3-c2d6c4c2793b', '8411bfa0-87b0-49a2-a1eb-a535d9d88274', '5e34b189-aa15-4302-9a41-1a1ce1edfa1e', 'a47e002a-325f-4303-8dea-86209028ebb0', 'ec7c3eec-28bb-4dcc-a740-eca86fce2578', 'e316a4c0-3a83-4827-a5c7-8cc4a342b65d', '64b82baf-96b3-4d2a-a0f3-634fd5e24137', '00a6980b-e22e-4c0a-a83a-f2c84907f57a', 'aa8a0a38-37aa-4674-acd4-bfc56f11a31e', '9f930f78-bc74-4f34-9558-0ffb6faee5ec', 'a279ae9a-5f5b-4b3f-a403-fcef8683474d', '032f92e2-50d8-4e5f-901e-8c80dbcfbdf5', '25f0058d-8729-4623-a291-7d3376597063', 'b1fb9da3-caa0-493e-935e-25393509c210', 'd9485466-865a-4183-ac2a-0720f6740f8a', '7a631474-f774-4747-8676-6477b61cae29', 'ea05aafd-d89a-4a4a-8f6a-25194a42d3e1', 'c7f76d7e-ac8b-403e-8138-5cfc21622e31'} {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 795.261077] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 795.282567] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.282567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.282567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.282567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.282935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.282935] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 795.282935] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 795.282935] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 795.334152] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.334300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.334351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.334692] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.335514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.335796] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 795.335876] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 795.335938] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 795.336013] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 795.336091] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/33 resources of Type:Security Group Rules [ 795.336162] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 with Priority: HIGH for action security_group_rules [ 795.336237] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGH for action security_group_rules [ 795.336304] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGH for action security_group_rules [ 795.336364] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 187f2eae-7657-4240-8ccd-728badf3526c with Priority: HIGH for action security_group_rules [ 795.336425] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 with Priority: HIGH for action security_group_rules [ 795.338254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.344718] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.345917] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.345917] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.345917] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.345917] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.345917] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 499cea77-3be0-431e-9a7f-9673ed5452bf not found, creating... [ 795.345917] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.346251] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.346251] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.346318] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.346427] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.346715] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.346857] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.346968] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.347176] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.348757] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.348757] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 499cea77-3be0-431e-9a7f-9673ed5452bf is going to be created. [ 795.366157] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.366157] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.366371] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.366527] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.366718] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.366921] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-499cea77-3be0-431e-9a7f-9673ed5452bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.527953] env[67003]: INFO networking_nsxv3.common.synchronization [req-220a7f3d-d000-44b3-975d-8cbb579f7da1 req-1f1e2521-54e7-48a4-a59d-9bec6a7306d8 tempest-ServerMetadataNegativeTestJSON-88088149 tempest-ServerMetadataNegativeTestJSON-88088149-project-member] Enqueued Resource ID: d9485466-865a-4183-ac2a-0720f6740f8a with Priority: HIGHEST for action security_group_members [ 795.529273] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9485466-865a-4183-ac2a-0720f6740f8a with Priority: HIGHEST for action security_group_members [ 795.529273] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 with Priority: HIGH for action security_group_rules [ 795.529273] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c with Priority: HIGH for action security_group_rules [ 795.529273] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGH for action security_group_rules [ 795.529783] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGH for action security_group_rules [ 795.529783] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 with Priority: HIGH for action security_group_rules [ 795.529901] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGH for action security_group_rules [ 795.529938] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e with Priority: HIGH for action security_group_rules [ 795.530093] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 with Priority: HIGH for action security_group_rules [ 795.530159] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b with Priority: HIGH for action security_group_rules [ 795.530265] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGH for action security_group_rules [ 795.530360] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 with Priority: HIGH for action security_group_rules [ 795.530455] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGH for action security_group_rules [ 795.530540] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGH for action security_group_rules [ 795.530630] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b with Priority: HIGH for action security_group_rules [ 795.530718] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 with Priority: HIGH for action security_group_rules [ 795.530804] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 with Priority: HIGH for action security_group_rules [ 795.530887] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGH for action security_group_rules [ 795.530989] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGH for action security_group_rules [ 795.531101] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGH for action security_group_rules [ 795.531175] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 187f2eae-7657-4240-8ccd-728badf3526c with Priority: HIGH for action security_group_rules [ 795.531460] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9485466-865a-4183-ac2a-0720f6740f8a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.531583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.531649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.531852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.532015] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.532123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.532184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.532329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.532412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.532599] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9485466-865a-4183-ac2a-0720f6740f8a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.533920] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-096a4cda-6a5e-4383-92c4-166cabe87e96 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.534037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.534366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.534366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.534366] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('096a4cda-6a5e-4383-92c4-166cabe87e96',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.535237] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.535427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.535517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.535692] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.535847] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe76f8c3-ada8-43f4-aca9-4d56d251b61c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.536481] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.536580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.536649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.536798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.536895] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.537922] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.538096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.538157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.538303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.538683] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.539384] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ec7c3eec-28bb-4dcc-a740-eca86fce2578 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.540028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.540028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.540028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.540028] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ec7c3eec-28bb-4dcc-a740-eca86fce2578',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.540810] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.540918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.541037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.541191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.541281] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.542159] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5e34b189-aa15-4302-9a41-1a1ce1edfa1e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.542283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.542352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.542526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.542600] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5e34b189-aa15-4302-9a41-1a1ce1edfa1e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.543425] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.543531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.543600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.543822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.543906] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8411bfa0-87b0-49a2-a1eb-a535d9d88274',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.546686] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.546845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.546888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.547039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.547148] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('529441da-dfe5-45a5-baf8-e2c1a0fd6f7b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.548026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.548124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.548194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.548500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.548500] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.548656] env[67003]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 795.549361] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8df0b4b9-9305-44fa-8ffb-138abad7c0b5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.549468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.549534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.549686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.549779] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8df0b4b9-9305-44fa-8ffb-138abad7c0b5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.551291] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0984692d-32cd-4b7f-9bd0-7496ca581278 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.551450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.551552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.551765] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.551843] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.552688] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.552797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.552863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.553429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.553429] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.553888] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4a2c13a-9225-49c6-996f-0d53b89aa94b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.553996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.554091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.554215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.554286] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4a2c13a-9225-49c6-996f-0d53b89aa94b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.556077] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-59de26fa-4c9b-4340-88dc-3e7c276b5c37 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.556077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.556077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.556077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.556077] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('59de26fa-4c9b-4340-88dc-3e7c276b5c37',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.556699] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43ab13f3-ab08-40ca-8026-84efbca23b63 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.556699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.556699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.556867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.556908] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43ab13f3-ab08-40ca-8026-84efbca23b63',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.557858] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.557858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.557992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.558195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.558195] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.559212] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.559421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.559421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.559563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.559653] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.560473] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.560580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.560646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.560822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.560911] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.563091] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-187f2eae-7657-4240-8ccd-728badf3526c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.563091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.563091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.563091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.563091] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('187f2eae-7657-4240-8ccd-728badf3526c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.563091] env[67003]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 795.567592] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.567740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.567817] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.568048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.635916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.636225] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.636356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.636425] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.636642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.636750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.636812] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9485466-865a-4183-ac2a-0720f6740f8a is going to be updated. [ 795.668598] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.668728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.668859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.669027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.669183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.678745] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9485466-865a-4183-ac2a-0720f6740f8a in Status: IN_PROGRESS for 2s [ 796.082768] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.082949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.082994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.083202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.085435] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.085587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.108400] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-0984692d-32cd-4b7f-9bd0-7496ca581278 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.108483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.109420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.109420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.109420] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.109420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.109420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.109420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.109420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.109816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.109816] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.116904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.116904] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe76f8c3-ada8-43f4-aca9-4d56d251b61c is going to be deleted. [ 796.129640] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.129640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.129640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.129640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.130021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.130799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.131034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.131352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.133017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.133017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.133017] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.133017] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.133017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.133017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.134215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.134215] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.134215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.134215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.137241] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.137241] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.137241] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.137241] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.141597] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.141789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.141901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.142141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.142335] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.142616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.142616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.142786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.142892] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.142998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.143122] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.145331] env[67003]: INFO networking_nsxv3.common.synchronization [req-e92d5f97-4ae7-4924-accf-4230497d3344 req-c0ec4a46-8ea2-4de6-8c76-ae2b4e248295 service nova] Enqueued Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_rules [ 796.145485] env[67003]: INFO networking_nsxv3.common.synchronization [req-e92d5f97-4ae7-4924-accf-4230497d3344 req-c0ec4a46-8ea2-4de6-8c76-ae2b4e248295 service nova] Enqueued Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_members [ 796.145716] env[67003]: INFO networking_nsxv3.common.synchronization [req-e92d5f97-4ae7-4924-accf-4230497d3344 req-c0ec4a46-8ea2-4de6-8c76-ae2b4e248295 service nova] Enqueued Resource ID: 499cea77-3be0-431e-9a7f-9673ed5452bf with Priority: HIGHEST for action port [ 796.146263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.146923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.155261] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.155392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.155458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.155649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.155830] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.155938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.156017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.156176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.156673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.156778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.156939] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.157047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.157283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.157448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.157608] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.157705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.157771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.157979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.158070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.158155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.158247] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.159878] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.159878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.159878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.159878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.159878] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.159878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.159878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.160217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.160217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.160217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.160304] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.160385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.160445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.160584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.160724] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.160813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.160875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.161173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.161173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.162251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.162393] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.169872] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.170989] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_rules [ 796.171111] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_members [ 796.171948] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 499cea77-3be0-431e-9a7f-9673ed5452bf with Priority: HIGHEST for action port [ 796.174864] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.175034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.178137] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a47e002a-325f-4303-8dea-86209028ebb0: rpc.has_security_group_logging(os_id): False [ 796.185505] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.185726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.185726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.185929] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.186029] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.188234] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.188234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.188234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.188234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.188234] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.188234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.188234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.188234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.188234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.188730] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.190337] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-499cea77-3be0-431e-9a7f-9673ed5452bf taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.190337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-499cea77-3be0-431e-9a7f-9673ed5452bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.190337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-499cea77-3be0-431e-9a7f-9673ed5452bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.190337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-499cea77-3be0-431e-9a7f-9673ed5452bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.190337] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('499cea77-3be0-431e-9a7f-9673ed5452bf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.237246] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.237635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.238433] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.238539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.241844] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.241844] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.241844] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.241844] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.241844] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.241844] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.242705] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.242705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.243359] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.243450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.244209] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.247112] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.247112] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.247112] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.247112] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.247112] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.247112] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 796.247465] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.247557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.248302] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 796.248867] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.248942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.249575] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 796.250031] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.250126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.251169] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 796.251613] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.251730] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 096a4cda-6a5e-4383-92c4-166cabe87e96 is going to be deleted. [ 796.253405] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.253506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.253574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.253772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.288771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.288771] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 59de26fa-4c9b-4340-88dc-3e7c276b5c37 is going to be deleted. [ 796.289259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.289584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.305026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.305156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.315117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.315253] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be deleted. [ 796.316314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.316558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.318153] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.318263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.342786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.342927] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5e34b189-aa15-4302-9a41-1a1ce1edfa1e is going to be deleted. [ 796.343935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.344161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.393048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.393048] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4a2c13a-9225-49c6-996f-0d53b89aa94b is going to be deleted. [ 796.394299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.394587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.403605] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.403772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.420574] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.420574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.437696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.437844] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 is going to be deleted. [ 796.438824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.439074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.463332] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.463451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.479771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.479829] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 529441da-dfe5-45a5-baf8-e2c1a0fd6f7b is going to be deleted. [ 796.480913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.481155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.540341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.540341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.549633] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.549633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.576657] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 796.577269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.577359] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8df0b4b9-9305-44fa-8ffb-138abad7c0b5 is going to be deleted. [ 796.578296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.578509] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.622859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.623213] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.623326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.623404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.623824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.623824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.623922] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.623972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.624051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.624198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.624271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.624453] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.624575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.624656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.624800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.624878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.624971] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 796.626450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.626667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.664082] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.664257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.664334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.664764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.664975] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.665133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.665219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.665408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.665533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.665678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.665886] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.666013] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.666109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.666282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.666452] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.666550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.666611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.666803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.666960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.667096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.667293] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.671538] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.671653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.674127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.674127] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 187f2eae-7657-4240-8ccd-728badf3526c is going to be deleted. [ 796.675598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.675832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.684128] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0984692d-32cd-4b7f-9bd0-7496ca581278: rpc.has_security_group_logging(os_id): False [ 796.685492] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d622b8c0-157c-4b92-b9e3-c2d6c4c2793b: rpc.has_security_group_logging(os_id): False [ 796.705475] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 499cea77-3be0-431e-9a7f-9673ed5452bf with status ACTIVE [ 796.705894] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.706070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.706193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.706402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.706514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.706745] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.706907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.707083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.707191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.707275] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.707489] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.707738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.707851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.707991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.708096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.708219] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 499cea77-3be0-431e-9a7f-9673ed5452bf is going to be updated. [ 796.709507] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.709618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.709773] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.714903] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.715036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.724853] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.725039] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8411bfa0-87b0-49a2-a1eb-a535d9d88274 is going to be deleted. [ 796.726046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.726304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.728701] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.728811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.769140] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.769140] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.777270] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.777451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.777515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.777791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.778028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.778148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-499cea77-3be0-431e-9a7f-9673ed5452bf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.779443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.779641] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be deleted. [ 796.780743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.781039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.820365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.820489] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be deleted. [ 796.821437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.822043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.875958] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.875958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.877483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.877612] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be deleted. [ 796.878902] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.879138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.880901] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.881053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.886977] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.887120] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.923026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.923026] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ec7c3eec-28bb-4dcc-a740-eca86fce2578 is going to be deleted. [ 796.923996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.924318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.924556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.924556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe76f8c3-ada8-43f4-aca9-4d56d251b61c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.924752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.924922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.925036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.925181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-096a4cda-6a5e-4383-92c4-166cabe87e96" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.925752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.925924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.926015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.926145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.926316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.926429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.926506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.926612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-59de26fa-4c9b-4340-88dc-3e7c276b5c37" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.926782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.926887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.926980] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.927123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5e34b189-aa15-4302-9a41-1a1ce1edfa1e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.927260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.927393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.927468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.927595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.927727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.927868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.927943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.928063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4a2c13a-9225-49c6-996f-0d53b89aa94b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.928219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.928364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.959407] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.959407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.966019] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.966019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.974637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.974637] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43ab13f3-ab08-40ca-8026-84efbca23b63 is going to be deleted. [ 796.975730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.975999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.976139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.976225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-529441da-dfe5-45a5-baf8-e2c1a0fd6f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.977961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.977961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.070581] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.070731] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.079021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.079021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.079021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.079021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.079021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.079021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.079021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.079021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.079021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.079021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.079021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.079021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.079021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.079021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.079688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.079688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.081120] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b is going to be updated. [ 797.084416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.085224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.139050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.139221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.169786] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aecf3eb9-1ca3-4c5d-973b-4e11d36881cc: rpc.has_security_group_logging(os_id): False [ 797.171700] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.172210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.183376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.185439] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.185439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.185439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.192033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.192033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.192033] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 is going to be updated. [ 797.192033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.192033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.196028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.196028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-187f2eae-7657-4240-8ccd-728badf3526c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.196028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.196028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.196028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.196028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8411bfa0-87b0-49a2-a1eb-a535d9d88274" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.196028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.196028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.196028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.196028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.199981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.200423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.201385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.201817] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.202069] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.202194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.202346] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.202540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.202761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.202867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.203020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.203248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.203539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.203647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.203789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8df0b4b9-9305-44fa-8ffb-138abad7c0b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.206442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.206442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.206442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.206442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ec7c3eec-28bb-4dcc-a740-eca86fce2578" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.206442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.206733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.206733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.206812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43ab13f3-ab08-40ca-8026-84efbca23b63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.212322] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.230355] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.230536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.230615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.230852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.304802] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 797.320263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.320596] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.320727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.320794] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.321031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.321122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.321420] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.321552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.321616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.321744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.321817] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.322075] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.322182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.322182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.322323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.322401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.322491] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc is going to be updated. [ 797.348890] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.349101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.349193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.349438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.349640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.374245] env[67003]: INFO networking_nsxv3.common.synchronization [req-f2dca549-9fdb-45ef-9c7f-5438b0e76ef1 req-dcc7e9a1-f956-4b7b-81d8-5cf4f71432dd tempest-ImagesTestJSON-830230457 tempest-ImagesTestJSON-830230457-project-member] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 797.374381] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 797.377398] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.377398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.377398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.377398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.377398] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.377398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.377398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.377398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.377398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.377398] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.379503] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: IN_PROGRESS for 2s [ 797.401796] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.401984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.402039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.402256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.402398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.429782] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 in Status: IN_PROGRESS for 2s [ 797.518513] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 797.522127] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.522301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.522402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.522653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.522806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.556677] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: IN_PROGRESS for 2s [ 797.689333] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9485466-865a-4183-ac2a-0720f6740f8a in Status: IN_PROGRESS for 4s [ 797.716802] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.720023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.720023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.720023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.720023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.720023] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc is going to be created. [ 797.769033] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.769033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.769033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.769033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.769033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.779555] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: UNINITIALIZED for 2s [ 797.831958] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-423 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.832361] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.832445] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.832752] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.833608] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.833608] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.833608] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.834062] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.834062] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.834062] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.834220] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.834361] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.834399] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.835397] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.835397] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.835397] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.853907] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.854119] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 797.854264] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.854463] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.854863] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-1889a871-b891-4cc2-a0c4-6535ba1bbf30 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.855055] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-1889a871-b891-4cc2-a0c4-6535ba1bbf30" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.855180] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-1889a871-b891-4cc2-a0c4-6535ba1bbf30" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.855553] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-1889a871-b891-4cc2-a0c4-6535ba1bbf30" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.855697] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1889a871-b891-4cc2-a0c4-6535ba1bbf30',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.878172] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.878396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.878396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.878631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.878695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.878870] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.879014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.879114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.879339] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.879423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.879508] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be deleted. [ 797.914119] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.914272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.914750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.914750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.914750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.914939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.361019] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.361019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.361019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.361019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.361019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.361019] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 1889a871-b891-4cc2-a0c4-6535ba1bbf30 not found, creating... [ 798.361521] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.361521] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.361979] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.361979] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.361979] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.362317] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.362505] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.362658] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.362912] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.363069] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.363212] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 1889a871-b891-4cc2-a0c4-6535ba1bbf30 is going to be created. [ 798.388579] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.388860] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.389061] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.389857] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.390318] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.391101] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-1889a871-b891-4cc2-a0c4-6535ba1bbf30" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.175688] env[67003]: INFO networking_nsxv3.common.synchronization [req-f2dca549-9fdb-45ef-9c7f-5438b0e76ef1 req-61736ce5-1438-42cd-8e9f-640731721608 service nova] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_rules [ 799.175997] env[67003]: INFO networking_nsxv3.common.synchronization [req-f2dca549-9fdb-45ef-9c7f-5438b0e76ef1 req-61736ce5-1438-42cd-8e9f-640731721608 service nova] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 799.176160] env[67003]: INFO networking_nsxv3.common.synchronization [req-f2dca549-9fdb-45ef-9c7f-5438b0e76ef1 req-61736ce5-1438-42cd-8e9f-640731721608 service nova] Enqueued Resource ID: 1889a871-b891-4cc2-a0c4-6535ba1bbf30 with Priority: HIGHEST for action port [ 799.176700] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_rules [ 799.176828] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 799.176921] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1889a871-b891-4cc2-a0c4-6535ba1bbf30 with Priority: HIGHEST for action port [ 799.177207] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.177324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.177439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.177663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.177748] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.178912] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.179042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.179112] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.179289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.183021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.183021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.183021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.183021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.183021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.183021] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.183021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-1889a871-b891-4cc2-a0c4-6535ba1bbf30 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.183021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1889a871-b891-4cc2-a0c4-6535ba1bbf30" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.183021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1889a871-b891-4cc2-a0c4-6535ba1bbf30" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.183021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1889a871-b891-4cc2-a0c4-6535ba1bbf30" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.183021] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1889a871-b891-4cc2-a0c4-6535ba1bbf30',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.324167] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 799.324538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.400227] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: SUCCESS [ 799.400227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.448023] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 in Status: SUCCESS [ 799.448023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.571419] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: SUCCESS [ 799.571419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.684384] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.684534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.685253] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.686171] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1889a871-b891-4cc2-a0c4-6535ba1bbf30 with status ACTIVE [ 799.686171] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.686171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.686171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.686465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.686465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.686557] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.686646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.686707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.686849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.686926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.687112] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.687227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.687256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.688941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.690695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.690695] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1889a871-b891-4cc2-a0c4-6535ba1bbf30 is going to be updated. [ 799.701602] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9485466-865a-4183-ac2a-0720f6740f8a in Status: SUCCESS [ 799.701602] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9485466-865a-4183-ac2a-0720f6740f8a deletion is rescheduled due to dependency. [ 799.701602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9485466-865a-4183-ac2a-0720f6740f8a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.717705] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.717983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.717983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.718333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.718333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.720059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1889a871-b891-4cc2-a0c4-6535ba1bbf30" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.793990] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: SUCCESS [ 799.794109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.794296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.794521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.794752] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.794875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.794939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.795121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.795251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.795394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.795721] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.191876] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.299184] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.697953] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.700191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.700433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.700565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.701060] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.701343] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be created. [ 800.730279] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.730546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.730546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.730643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.732139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.743858] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: UNINITIALIZED for 2s [ 800.802172] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ec9467a-c24b-4be1-ba5a-173726e27cfc: rpc.has_security_group_logging(os_id): False [ 800.822781] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.822973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.822973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.823220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.823298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.823583] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.823985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.823985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.823985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.823985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.824164] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc is going to be created. [ 800.892575] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.892791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.892791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.893070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.893208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.913647] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: IN_PROGRESS for 2s [ 802.757622] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 802.758118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.758118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.758313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.758455] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.758614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.758698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.758796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.758911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.758967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.759067] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.952368] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: SUCCESS [ 802.952687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.265024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.265024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.265024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.265024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.265024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.265024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.265024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.265024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.265024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.265024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.265024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.265024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.265024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.265024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.265024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.265024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.265773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.265773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.265773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.265773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.265773] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.493813] env[67003]: INFO networking_nsxv3.common.synchronization [None req-fad209a0-ea56-40b5-8bc6-6fff0226c380 None None] Enqueued Resource ID: 31a0c8d0-d87e-4b26-9d88-3e8ea9c09cc6 with Priority: HIGHEST for action port [ 803.496192] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a0c8d0-d87e-4b26-9d88-3e8ea9c09cc6 with Priority: HIGHEST for action port [ 803.496516] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-31a0c8d0-d87e-4b26-9d88-3e8ea9c09cc6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.496713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31a0c8d0-d87e-4b26-9d88-3e8ea9c09cc6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.496803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31a0c8d0-d87e-4b26-9d88-3e8ea9c09cc6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.497180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31a0c8d0-d87e-4b26-9d88-3e8ea9c09cc6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.497782] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a0c8d0-d87e-4b26-9d88-3e8ea9c09cc6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.767971] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c06f8726-ef82-4058-ad8d-7e0aabd079e1: rpc.has_security_group_logging(os_id): False [ 803.787654] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.787932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.788044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.788296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.788388] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.788634] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.788754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.788815] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.788975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.789080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.789261] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.789373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.789433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.789573] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.789647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.789844] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.789952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.790029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.790160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.790231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.790316] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be created. [ 803.866194] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.866194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.866194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.866194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.866830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.897858] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 804.000495] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31a0c8d0-d87e-4b26-9d88-3e8ea9c09cc6 [ 804.000823] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.000979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.001082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.001420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.001549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.001695] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31a0c8d0-d87e-4b26-9d88-3e8ea9c09cc6 already deleted. [ 804.002071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31a0c8d0-d87e-4b26-9d88-3e8ea9c09cc6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.679178] env[67003]: INFO networking_nsxv3.common.synchronization [req-7533e4b7-1653-4387-bc5c-48ab5e605f12 req-41677f89-dd7e-4475-a61e-9cb0040a493c tempest-FloatingIPsAssociationTestJSON-1536953296 tempest-FloatingIPsAssociationTestJSON-1536953296-project-member] Enqueued Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_members [ 805.680376] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGHEST for action security_group_members [ 805.680519] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.680583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.680650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.680845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.681203] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.681203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.681203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.681349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.681635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.681635] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.866489] env[67003]: INFO networking_nsxv3.common.synchronization [req-127e2dc2-f0e4-4524-a531-6c2c02017e0b req-f01fa2cf-f6a3-4a30-b54c-00b6ca09119c tempest-ServerGroupTestJSON-914531957 tempest-ServerGroupTestJSON-914531957-project-member] Enqueued Resource ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 with Priority: HIGHEST for action security_group_members [ 805.867726] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 with Priority: HIGHEST for action security_group_members [ 805.867726] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.867726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.867726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.867726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.868078] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.868078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.868078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.868213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.868282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.868373] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cb3702a-8afa-4d0e-bd1f-17a5225e0319',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.918942] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 805.919292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.139367] env[67003]: INFO networking_nsxv3.common.synchronization [None req-33c58952-3964-4846-9f81-64da0e164a6c None None] Enqueued Resource ID: 27b47b25-f263-4b7e-be16-7c377529244a with Priority: HIGHEST for action port [ 806.140212] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b47b25-f263-4b7e-be16-7c377529244a with Priority: HIGHEST for action port [ 806.140584] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-27b47b25-f263-4b7e-be16-7c377529244a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.140746] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27b47b25-f263-4b7e-be16-7c377529244a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.140867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27b47b25-f263-4b7e-be16-7c377529244a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.141270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27b47b25-f263-4b7e-be16-7c377529244a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.141356] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27b47b25-f263-4b7e-be16-7c377529244a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.184412] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.184412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.184647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.184753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.215915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.216218] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.216362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.216405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.216607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.216686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.216773] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d is going to be updated. [ 806.280793] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-379 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.281015] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-379" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.281144] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-379" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.281492] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-379" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.281756] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.281917] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.282971] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.283316] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.283850] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.284390] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.284552] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 806.284732] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 806.285455] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 806.285642] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 806.285788] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 806.285957] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 806.288043] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.288256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.288370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.288610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.288788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.301524] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: IN_PROGRESS for 2s [ 806.320469] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 806.320658] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 806.320868] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 806.321104] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-379" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.321510] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-0bb63070-7b43-4e32-a16c-37059afc9fa6 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.321736] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-0bb63070-7b43-4e32-a16c-37059afc9fa6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.321917] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-0bb63070-7b43-4e32-a16c-37059afc9fa6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.322487] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-0bb63070-7b43-4e32-a16c-37059afc9fa6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.322487] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bb63070-7b43-4e32-a16c-37059afc9fa6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.371243] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.371406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.371465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.371682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.371841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.371965] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.372070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.372130] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.372307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.372412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.372770] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 already deleted. [ 806.372913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.645017] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27b47b25-f263-4b7e-be16-7c377529244a [ 806.645017] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.645273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.645273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.645455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.645486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.645577] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27b47b25-f263-4b7e-be16-7c377529244a already deleted. [ 806.645686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27b47b25-f263-4b7e-be16-7c377529244a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.826648] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.827692] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.827692] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.827889] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.828139] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.828216] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 0bb63070-7b43-4e32-a16c-37059afc9fa6 not found, creating... [ 806.828732] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.828732] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.828878] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.829054] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.829436] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.829526] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.829767] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.829853] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.830088] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.830226] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.830371] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 0bb63070-7b43-4e32-a16c-37059afc9fa6 is going to be created. [ 806.853526] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.853743] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.853868] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.854182] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.854413] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.854702] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-0bb63070-7b43-4e32-a16c-37059afc9fa6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.520840] env[67003]: INFO networking_nsxv3.common.synchronization [req-6406d7aa-d9a6-4f65-bb57-eadd9ecfa99e req-53fa818c-9030-4e58-8013-d1e63004e345 tempest-ImagesOneServerNegativeTestJSON-533995407 tempest-ImagesOneServerNegativeTestJSON-533995407-project-member] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 807.521448] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 807.521779] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.521908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.521975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.522194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.522351] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.522448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.522546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.522693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.522781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.522879] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.605076] env[67003]: INFO networking_nsxv3.common.synchronization [req-127e2dc2-f0e4-4524-a531-6c2c02017e0b req-52b864b2-4e53-4a0f-a330-cf3feb07eec3 service nova] Enqueued Resource ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 with Priority: HIGHEST for action security_group_rules [ 807.605262] env[67003]: INFO networking_nsxv3.common.synchronization [req-127e2dc2-f0e4-4524-a531-6c2c02017e0b req-52b864b2-4e53-4a0f-a330-cf3feb07eec3 service nova] Enqueued Resource ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 with Priority: HIGHEST for action security_group_members [ 807.605469] env[67003]: INFO networking_nsxv3.common.synchronization [req-127e2dc2-f0e4-4524-a531-6c2c02017e0b req-52b864b2-4e53-4a0f-a330-cf3feb07eec3 service nova] Enqueued Resource ID: 0bb63070-7b43-4e32-a16c-37059afc9fa6 with Priority: HIGHEST for action port [ 807.607036] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 with Priority: HIGHEST for action security_group_rules [ 807.607036] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 with Priority: HIGHEST for action security_group_members [ 807.607036] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bb63070-7b43-4e32-a16c-37059afc9fa6 with Priority: HIGHEST for action port [ 807.607036] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cb3702a-8afa-4d0e-bd1f-17a5225e0319 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.607271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.607271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.607462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.607540] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cb3702a-8afa-4d0e-bd1f-17a5225e0319',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.609285] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.609368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.609420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.609824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.609824] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.610154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.610154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.610154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.610259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.610294] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cb3702a-8afa-4d0e-bd1f-17a5225e0319',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.612320] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bb63070-7b43-4e32-a16c-37059afc9fa6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.612320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bb63070-7b43-4e32-a16c-37059afc9fa6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.612320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bb63070-7b43-4e32-a16c-37059afc9fa6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.612320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bb63070-7b43-4e32-a16c-37059afc9fa6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.612320] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bb63070-7b43-4e32-a16c-37059afc9fa6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.019216] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-784 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.019579] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-784" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.019579] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-784" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.019801] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-784" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.020075] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.020238] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.020353] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.020568] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.020709] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.020928] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.021024] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 808.021135] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 808.021240] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 808.021348] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 808.021454] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 808.021582] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 808.024889] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.025040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.025082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.025355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.025447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.025647] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.025792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.025868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.026043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.026125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.026214] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be deleted. [ 808.044520] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 808.044737] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 808.044901] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 808.045144] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-784" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.045476] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.045700] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.045876] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.046301] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.046510] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.058560] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.058751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.058751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.058965] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.059079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.059178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.113209] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cb3702a-8afa-4d0e-bd1f-17a5225e0319',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.115101] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.115278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.115842] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0bb63070-7b43-4e32-a16c-37059afc9fa6 with status ACTIVE [ 808.116121] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.116389] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.116479] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.116697] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.116790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.117056] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.117172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.117251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.117515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.117614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.117847] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.117948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.118021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.118166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.118242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.118327] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0bb63070-7b43-4e32-a16c-37059afc9fa6 is going to be updated. [ 808.150245] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.150382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.150465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.150644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.150784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.150966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bb63070-7b43-4e32-a16c-37059afc9fa6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.314702] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d in Status: SUCCESS [ 808.314924] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d deletion is rescheduled due to dependency. [ 808.315080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.550336] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.550660] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.550814] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.551336] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.551453] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.551593] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45 not found, creating... [ 808.551967] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.552222] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.552405] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.552748] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.552897] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.553333] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.553501] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.553622] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.553875] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.554058] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.554275] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45 is going to be created. [ 808.580989] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.580989] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.580989] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.581393] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.581485] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.581831] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.619234] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cb3702a-8afa-4d0e-bd1f-17a5225e0319',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.123763] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.124072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.124072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.124272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.124314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.124384] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 is going to be created. [ 809.150179] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.150350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.150421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.150979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.150979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.164376] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 in Status: UNINITIALIZED for 2s [ 809.323270] env[67003]: INFO networking_nsxv3.common.synchronization [req-6406d7aa-d9a6-4f65-bb57-eadd9ecfa99e req-a57dbc20-0726-414e-8747-9bb951f2b0f6 service nova] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_rules [ 809.323588] env[67003]: INFO networking_nsxv3.common.synchronization [req-6406d7aa-d9a6-4f65-bb57-eadd9ecfa99e req-a57dbc20-0726-414e-8747-9bb951f2b0f6 service nova] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 809.323846] env[67003]: INFO networking_nsxv3.common.synchronization [req-6406d7aa-d9a6-4f65-bb57-eadd9ecfa99e req-a57dbc20-0726-414e-8747-9bb951f2b0f6 service nova] Enqueued Resource ID: 7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45 with Priority: HIGHEST for action port [ 809.324792] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_rules [ 809.324976] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 809.325132] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45 with Priority: HIGHEST for action port [ 809.325388] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.325567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.325630] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.325847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.326022] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.326911] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.327222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.327281] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.327458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.327614] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.327710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.327773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.327915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.328011] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.328130] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.329370] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.329514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.329562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.329704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.329781] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.832940] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.833468] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.833590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.833848] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45 with status ACTIVE [ 809.834134] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.834292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.834378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.834582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.834733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.834949] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.835064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.835129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.835304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.835304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.836190] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.836190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.836190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.836190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.836190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.836190] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45 is going to be updated. [ 809.875288] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.876034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.876034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.876034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.876243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.876405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7cf0ddf5-6d9b-42e3-b9e7-96bfc0fafa45" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.338210] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.840629] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.840899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.840899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.841299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.841393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.841525] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be created. [ 810.872771] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.872970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.873051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.873317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.873531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.884960] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: UNINITIALIZED for 2s [ 811.184224] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 in Status: SUCCESS [ 811.184224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.184224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.184463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.184604] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.184816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.184896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.185131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.185250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.185833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.185833] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cb3702a-8afa-4d0e-bd1f-17a5225e0319',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.188368] env[67003]: INFO networking_nsxv3.common.synchronization [req-086b4844-53f4-4c16-a47c-6c5ce88f0c87 req-736c7c6a-c1ec-4270-9f39-dcf6a58399be tempest-ServerDiskConfigTestJSON-448903628 tempest-ServerDiskConfigTestJSON-448903628-project-member] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 811.189683] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 811.189908] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.190129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.190306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.190714] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.191042] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.191346] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.192474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.192474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.192474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.192474] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.689685] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.689985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.689985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.690155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.690361] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.690473] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.690559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.690739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.690837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.690925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.692587] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.692587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.692587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.692587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.692587] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.692587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.692587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.692587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.692587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.692587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.692587] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cb3702a-8afa-4d0e-bd1f-17a5225e0319',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.694297] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.694429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.694550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.694615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.735148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.735148] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.735737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.735737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.735737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.736693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.736693] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 811.806025] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.806025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.806025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.806025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.806025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.814983] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 812.200775] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cb3702a-8afa-4d0e-bd1f-17a5225e0319: rpc.has_security_group_logging(os_id): False [ 812.222194] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.222409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.222409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.222617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.222705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.222921] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.223030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.223087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.223235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.223309] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.223481] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.223573] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.223720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.223810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.223861] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.224535] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.224535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.224535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.224535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.224535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.224535] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 is going to be created. [ 812.292605] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.292795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.292906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.293354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.293620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.307697] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 in Status: IN_PROGRESS for 2s [ 812.896126] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: SUCCESS [ 812.896428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.896428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.896582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.896792] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.896925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.897091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.897262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.898067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.898067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.898067] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.400257] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.400578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.400698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.401188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.401393] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.401572] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.401686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.401947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.402131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.402673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.402673] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.402949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.402949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.403064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.403308] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.403477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.403587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.403829] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.403975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.404138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.404295] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.829074] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 813.829265] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 deletion is rescheduled due to dependency. [ 813.829265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.857182] env[67003]: INFO networking_nsxv3.common.synchronization [None req-77f45162-5d14-4000-8684-312d778c6fe5 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGHEST for action security_group_rules [ 813.857854] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGHEST for action security_group_rules [ 813.858432] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2e25f5a-d04c-463f-a7f6-17866b02d583 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.858657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.859035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.859273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.859422] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2e25f5a-d04c-463f-a7f6-17866b02d583',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.907605] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94cc9917-b413-4c1b-9c52-44b1bbb1141a: rpc.has_security_group_logging(os_id): False [ 813.928854] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.929254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.929412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.929779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.929987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.930543] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.930543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.930866] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.931050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.931154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.931538] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.931753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.931872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.932180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.932427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.932720] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.932911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.933031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.933363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.933541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.933693] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be created. [ 814.012023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.012023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.012023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.012023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.012023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.015512] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ed8cf4d8-30f4-4c26-9869-adc09b4b8412 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGHEST for action security_group_rules [ 814.016610] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGHEST for action security_group_rules [ 814.017193] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2e25f5a-d04c-463f-a7f6-17866b02d583 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.017493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.039419] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: IN_PROGRESS for 2s [ 814.195538] env[67003]: INFO networking_nsxv3.common.synchronization [req-5675b1d4-d40c-498d-8efe-63bd04078ec3 req-82d75470-ec1a-4e71-9840-cb3287e155d3 tempest-ServersAdminTestJSON-1432619756 tempest-ServersAdminTestJSON-1432619756-project-member] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 814.199611] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 814.199611] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.199611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.199611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.199611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.199611] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.199611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.199611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.199611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.199611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.199611] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.324612] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 in Status: SUCCESS [ 814.325812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.384850] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.384850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.384850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.384850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.385388] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.385388] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 already deleted. [ 814.385388] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.385388] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.385571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.385618] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2e25f5a-d04c-463f-a7f6-17866b02d583',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.702158] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.911043] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.911043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.911043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.911621] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.911621] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.911621] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 already deleted. [ 814.911621] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.208856] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.712987] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.712987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.712987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.713340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.713465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.713673] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 815.745687] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.745838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.745908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.746193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.746792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.757988] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 816.055474] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: SUCCESS [ 816.055785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.778283] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 817.778780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.197545] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 819.197975] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 820.659142] env[67003]: INFO networking_nsxv3.common.synchronization [req-252025b7-7aec-4360-9b00-ac1a1b0a89f1 req-b09a2793-1111-4bb8-b0ba-90eaabdbbc32 tempest-ServerGroupTestJSON-914531957 tempest-ServerGroupTestJSON-914531957-project-member] Enqueued Resource ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 with Priority: HIGHEST for action security_group_members [ 820.659814] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 with Priority: HIGHEST for action security_group_members [ 820.662049] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.662232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.662232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.662386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.662570] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.662683] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.662742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.663542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.663542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.663542] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cb3702a-8afa-4d0e-bd1f-17a5225e0319',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.868646] env[67003]: INFO networking_nsxv3.common.synchronization [req-7043041c-b32c-4931-a290-375272e9f76b req-fb484257-3686-4a3a-bce1-6d1b2aeebea0 tempest-ListServerFiltersTestJSON-449543784 tempest-ListServerFiltersTestJSON-449543784-project-member] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 820.869708] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 820.869965] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.870294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.870366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.870639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.870809] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.870921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.870985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.871211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.871327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.871458] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.165705] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.166009] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.166174] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.166467] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.167251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.167595] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.167797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.168054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.168595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.168595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.168595] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 is going to be updated. [ 821.204518] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.204656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.204826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.205253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.205533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.217766] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.218012] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-108" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.218159] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-108" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.218424] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-108" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.218750] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.218925] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.219054] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.219277] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.219419] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.219619] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.219725] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 821.219833] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 821.219943] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 821.220343] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 821.220343] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 821.220343] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 821.222108] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 in Status: IN_PROGRESS for 2s [ 821.265601] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 821.265857] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.045 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 821.266109] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 821.266386] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-108" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.266800] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-9cc653ac-c677-40c1-b378-1c3d6e7b9919 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.267103] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-9cc653ac-c677-40c1-b378-1c3d6e7b9919" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.267267] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-9cc653ac-c677-40c1-b378-1c3d6e7b9919" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.267664] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-9cc653ac-c677-40c1-b378-1c3d6e7b9919" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.267837] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cc653ac-c677-40c1-b378-1c3d6e7b9919',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.374182] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.374340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.374445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.374656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.374835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.375053] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.375171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.375227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.375386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.375463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.375550] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 already deleted. [ 821.375631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.770968] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.771461] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.771623] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.772048] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.772281] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.772462] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 9cc653ac-c677-40c1-b378-1c3d6e7b9919 not found, creating... [ 821.772858] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.773106] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.773274] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.773555] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.773749] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.774076] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.774244] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.774359] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.774594] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.774808] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.774991] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 9cc653ac-c677-40c1-b378-1c3d6e7b9919 is going to be created. [ 821.808674] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.808916] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.808997] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.809413] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.809664] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.809886] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-9cc653ac-c677-40c1-b378-1c3d6e7b9919" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.475844] env[67003]: INFO networking_nsxv3.common.synchronization [req-7043041c-b32c-4931-a290-375272e9f76b req-fa28e61b-fdc9-497b-8123-b8f449bc8113 service nova] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_rules [ 822.475844] env[67003]: INFO networking_nsxv3.common.synchronization [req-7043041c-b32c-4931-a290-375272e9f76b req-fa28e61b-fdc9-497b-8123-b8f449bc8113 service nova] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 822.475844] env[67003]: INFO networking_nsxv3.common.synchronization [req-7043041c-b32c-4931-a290-375272e9f76b req-fa28e61b-fdc9-497b-8123-b8f449bc8113 service nova] Enqueued Resource ID: 9cc653ac-c677-40c1-b378-1c3d6e7b9919 with Priority: HIGHEST for action port [ 822.475844] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_rules [ 822.475844] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 822.476272] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc653ac-c677-40c1-b378-1c3d6e7b9919 with Priority: HIGHEST for action port [ 822.476748] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.477029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.477209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.477546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.477756] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.478834] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.479116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.479287] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.479563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.481527] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.481910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.481910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.482091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.482150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.482279] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.484119] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cc653ac-c677-40c1-b378-1c3d6e7b9919 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.484281] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cc653ac-c677-40c1-b378-1c3d6e7b9919" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.484394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cc653ac-c677-40c1-b378-1c3d6e7b9919" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.484610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cc653ac-c677-40c1-b378-1c3d6e7b9919" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.484728] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cc653ac-c677-40c1-b378-1c3d6e7b9919',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.986997] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.988178] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.988327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.988450] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9cc653ac-c677-40c1-b378-1c3d6e7b9919 with status ACTIVE [ 822.988624] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.988755] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.988813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.989000] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.989101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.989267] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.989368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.990111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.990111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.990111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.990111] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.990111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.990111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.990379] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.990379] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.990379] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9cc653ac-c677-40c1-b378-1c3d6e7b9919 is going to be updated. [ 823.020725] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.020947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.020947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.021147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.021284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.021441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cc653ac-c677-40c1-b378-1c3d6e7b9919" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.233290] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 in Status: SUCCESS [ 823.233606] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 deletion is rescheduled due to dependency. [ 823.233779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.474531] env[67003]: INFO networking_nsxv3.common.synchronization [req-ef77504e-a3c0-4b9e-b9f5-4875a9b79098 req-b256781f-85fa-4a04-b32c-8fe4ca20a26c tempest-ListServerFiltersTestJSON-449543784 tempest-ListServerFiltersTestJSON-449543784-project-member] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 823.475351] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 823.475772] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.475918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.492796] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.826359] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.826554] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-108" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.826675] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-108" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.826948] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-108" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.827233] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.827386] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.827502] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.827792] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.827967] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.828422] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.828540] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.828664] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.828777] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.828888] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.828990] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.829140] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.849545] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.849764] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.849962] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.850998] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-108" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.851427] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-fc6d2c77-065a-4b08-899e-a3476c10f5b6 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.851685] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-fc6d2c77-065a-4b08-899e-a3476c10f5b6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.851833] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-fc6d2c77-065a-4b08-899e-a3476c10f5b6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.852191] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-fc6d2c77-065a-4b08-899e-a3476c10f5b6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.852332] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc6d2c77-065a-4b08-899e-a3476c10f5b6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.997182] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.997563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.997563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.997563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.997660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.997807] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 is going to be created. [ 824.024184] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.024497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.024497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.024627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.024785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.035677] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: UNINITIALIZED for 2s [ 824.354956] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.355130] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.355263] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.355577] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.355803] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.356096] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port fc6d2c77-065a-4b08-899e-a3476c10f5b6 not found, creating... [ 824.356419] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.356671] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.356801] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.357086] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.357267] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.357617] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.357813] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.357944] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.358221] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.358386] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.358558] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: fc6d2c77-065a-4b08-899e-a3476c10f5b6 is going to be created. [ 824.382507] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.382724] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.382855] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.383178] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.383442] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.383672] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-fc6d2c77-065a-4b08-899e-a3476c10f5b6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.104819] env[67003]: INFO networking_nsxv3.common.synchronization [req-ef77504e-a3c0-4b9e-b9f5-4875a9b79098 req-bf2532ac-ed23-40c4-b410-fcac1361a46d service nova] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_rules [ 825.105166] env[67003]: INFO networking_nsxv3.common.synchronization [req-ef77504e-a3c0-4b9e-b9f5-4875a9b79098 req-bf2532ac-ed23-40c4-b410-fcac1361a46d service nova] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 825.105224] env[67003]: INFO networking_nsxv3.common.synchronization [req-ef77504e-a3c0-4b9e-b9f5-4875a9b79098 req-bf2532ac-ed23-40c4-b410-fcac1361a46d service nova] Enqueued Resource ID: fc6d2c77-065a-4b08-899e-a3476c10f5b6 with Priority: HIGHEST for action port [ 825.105779] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_rules [ 825.105905] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 825.106010] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc6d2c77-065a-4b08-899e-a3476c10f5b6 with Priority: HIGHEST for action port [ 825.106747] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.106855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.107151] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.107286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.107549] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc6d2c77-065a-4b08-899e-a3476c10f5b6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.107674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc6d2c77-065a-4b08-899e-a3476c10f5b6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.107754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc6d2c77-065a-4b08-899e-a3476c10f5b6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.108060] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc6d2c77-065a-4b08-899e-a3476c10f5b6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.108109] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc6d2c77-065a-4b08-899e-a3476c10f5b6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.611403] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fc6d2c77-065a-4b08-899e-a3476c10f5b6 with status ACTIVE [ 825.611765] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.611909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.611975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.612249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.612370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.612606] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.612750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.612818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.612984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.613080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.613276] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.613369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.613430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.613598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.613682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.614153] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fc6d2c77-065a-4b08-899e-a3476c10f5b6 is going to be updated. [ 825.636911] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.637197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.637297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.637590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.637772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.638052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc6d2c77-065a-4b08-899e-a3476c10f5b6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.045320] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: SUCCESS [ 826.045635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.045814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.046142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.046335] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.046453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.046510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.046726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.046761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.046830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.046933] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.047811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.048008] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.048208] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.048312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.048639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.048639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.048639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.048639] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.551779] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.552266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.552266] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.054957] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.558498] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.558498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.558498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.559034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.559034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.559034] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 is going to be updated. [ 827.600925] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.601142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.601290] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.601563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.601764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.613129] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: IN_PROGRESS for 2s [ 828.229620] env[67003]: INFO networking_nsxv3.common.synchronization [req-d76ec834-8cc8-477c-801d-20fd2254fd57 req-68487b53-9821-4e70-9d47-5269dce92b9d tempest-ListServersNegativeTestJSON-1594397262 tempest-ListServersNegativeTestJSON-1594397262-project-member] Enqueued Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 828.230666] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 828.231016] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.231162] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.231234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.231510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.231681] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.231800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.231962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.232195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.232349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.232447] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.700335] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-311 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.700335] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-311" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.700335] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-311" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.700335] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-311" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.700335] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.700335] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.700952] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.700952] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.700952] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.701093] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.702493] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.702493] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.702493] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.702493] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.702493] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.702493] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.725164] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.726085] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.726085] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.726085] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-311" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.726699] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-4fa47cf9-c1a0-4f95-928e-922be70b684e taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.726856] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-4fa47cf9-c1a0-4f95-928e-922be70b684e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.727543] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-4fa47cf9-c1a0-4f95-928e-922be70b684e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.727658] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-4fa47cf9-c1a0-4f95-928e-922be70b684e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.727953] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fa47cf9-c1a0-4f95-928e-922be70b684e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.736715] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.736715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.736715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.736942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.736942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.737247] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.737363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.737424] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.737612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.737711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.737818] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 already deleted. [ 828.737930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.231352] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.231692] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.231934] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.232341] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.232591] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.232852] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 4fa47cf9-c1a0-4f95-928e-922be70b684e not found, creating... [ 829.233205] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.233401] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.233539] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.233774] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.233926] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.234269] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.234443] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.234570] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.234789] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.234980] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.235142] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 4fa47cf9-c1a0-4f95-928e-922be70b684e is going to be created. [ 829.256932] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.257197] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.257332] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.257624] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.257927] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.258115] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-4fa47cf9-c1a0-4f95-928e-922be70b684e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.623112] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: SUCCESS [ 829.623510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.623510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.623692] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.623878] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.623994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.624070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.624222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.624305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.624394] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.999485] env[67003]: INFO networking_nsxv3.common.synchronization [req-d76ec834-8cc8-477c-801d-20fd2254fd57 req-14b25491-7449-4e63-a410-7bd49329e037 service nova] Enqueued Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_rules [ 829.999749] env[67003]: INFO networking_nsxv3.common.synchronization [req-d76ec834-8cc8-477c-801d-20fd2254fd57 req-14b25491-7449-4e63-a410-7bd49329e037 service nova] Enqueued Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 829.999811] env[67003]: INFO networking_nsxv3.common.synchronization [req-d76ec834-8cc8-477c-801d-20fd2254fd57 req-14b25491-7449-4e63-a410-7bd49329e037 service nova] Enqueued Resource ID: 4fa47cf9-c1a0-4f95-928e-922be70b684e with Priority: HIGHEST for action port [ 830.000527] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_rules [ 830.000711] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 830.000841] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fa47cf9-c1a0-4f95-928e-922be70b684e with Priority: HIGHEST for action port [ 830.001189] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.001335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.001416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.001684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.001777] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.002834] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.002896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.002929] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.003150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.003305] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.003422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.003496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.003686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.003756] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.003864] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.004995] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-4fa47cf9-c1a0-4f95-928e-922be70b684e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.005142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4fa47cf9-c1a0-4f95-928e-922be70b684e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.005215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4fa47cf9-c1a0-4f95-928e-922be70b684e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.005391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4fa47cf9-c1a0-4f95-928e-922be70b684e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.005480] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4fa47cf9-c1a0-4f95-928e-922be70b684e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.127642] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.507855] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.507855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.507855] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.508946] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4fa47cf9-c1a0-4f95-928e-922be70b684e with status ACTIVE [ 830.509332] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.509332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.509521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.509766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.509935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.510161] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.510334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.510416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.510639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.510723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.511186] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.511314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.511383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.511529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.511605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.511692] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4fa47cf9-c1a0-4f95-928e-922be70b684e is going to be updated. [ 830.569269] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.569454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.569495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.569904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.569904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.570053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4fa47cf9-c1a0-4f95-928e-922be70b684e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.630843] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.773379] env[67003]: INFO networking_nsxv3.common.synchronization [req-197a85a2-f79a-4e42-a6d6-801051cb70d7 req-a15c3f46-afb3-49a9-a24d-8bc22ecf2bb6 tempest-ImagesTestJSON-830230457 tempest-ImagesTestJSON-830230457-project-member] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 830.774170] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 830.774293] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.774416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.774492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.774680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.774888] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.775405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.775405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.775405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.775405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.775405] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.016293] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.070542] env[67003]: INFO networking_nsxv3.common.synchronization [req-d76ec834-8cc8-477c-801d-20fd2254fd57 req-05e43d2a-1b05-4ac9-8c7d-f1540bf41b69 tempest-ListServersNegativeTestJSON-1594397262 tempest-ListServersNegativeTestJSON-1594397262-project-member] Enqueued Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 831.071119] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 831.071545] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.071731] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.132610] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.132847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.132847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.133099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.133192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.133310] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 is going to be updated. [ 831.160544] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.160709] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.160770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.160963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.161146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.170167] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: IN_PROGRESS for 2s [ 831.280179] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.280340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.280415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.280647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.280778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.281097] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.281097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.281232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.281309] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.281391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.281480] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 831.316034] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.316034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.316034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.316034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.316034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.319907] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 831.440220] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-311 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.440828] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-311" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.440828] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-311" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.443213] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-311" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.443213] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.443213] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.443213] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.443213] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.443213] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.443213] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.443213] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.443213] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.443213] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.443975] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.444923] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.444923] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.465418] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.465525] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 831.465631] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.465825] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-311" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.466192] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-36befdad-9fc8-4f96-b08c-86648732bf9c taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.467388] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-36befdad-9fc8-4f96-b08c-86648732bf9c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.467388] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-36befdad-9fc8-4f96-b08c-86648732bf9c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.467388] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-36befdad-9fc8-4f96-b08c-86648732bf9c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.467388] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36befdad-9fc8-4f96-b08c-86648732bf9c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.519183] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.519353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.519424] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.519664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.519787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.519899] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 is going to be created. [ 831.545144] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.546031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.546031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.546244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.546434] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.560157] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: UNINITIALIZED for 2s [ 831.971022] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.971022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.971022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.971022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.971022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.971022] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 36befdad-9fc8-4f96-b08c-86648732bf9c not found, creating... [ 831.971022] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.971022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.971022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.971536] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.971536] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.971621] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.971814] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.971911] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.973281] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.973482] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.974177] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 36befdad-9fc8-4f96-b08c-86648732bf9c is going to be created. [ 832.000930] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.001243] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.001450] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.001730] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.001972] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.002250] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-36befdad-9fc8-4f96-b08c-86648732bf9c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.713661] env[67003]: INFO networking_nsxv3.common.synchronization [req-d76ec834-8cc8-477c-801d-20fd2254fd57 req-0c96fcc5-c8bc-4e65-91c8-d9f8af8ee3cf service nova] Enqueued Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_rules [ 832.713661] env[67003]: INFO networking_nsxv3.common.synchronization [req-d76ec834-8cc8-477c-801d-20fd2254fd57 req-0c96fcc5-c8bc-4e65-91c8-d9f8af8ee3cf service nova] Enqueued Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 832.713661] env[67003]: INFO networking_nsxv3.common.synchronization [req-d76ec834-8cc8-477c-801d-20fd2254fd57 req-0c96fcc5-c8bc-4e65-91c8-d9f8af8ee3cf service nova] Enqueued Resource ID: 36befdad-9fc8-4f96-b08c-86648732bf9c with Priority: HIGHEST for action port [ 832.713661] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_rules [ 832.713661] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 832.713661] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 36befdad-9fc8-4f96-b08c-86648732bf9c with Priority: HIGHEST for action port [ 832.713661] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.713661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.713661] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.713661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.713661] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-36befdad-9fc8-4f96-b08c-86648732bf9c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.714986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-36befdad-9fc8-4f96-b08c-86648732bf9c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.714986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-36befdad-9fc8-4f96-b08c-86648732bf9c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.714986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-36befdad-9fc8-4f96-b08c-86648732bf9c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.714986] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('36befdad-9fc8-4f96-b08c-86648732bf9c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.837395] env[67003]: INFO networking_nsxv3.common.synchronization [req-fa7bde3b-df51-456b-81bc-8bf649cc778c req-39e70cb0-630f-47ec-985b-632773a34596 tempest-ImagesOneServerNegativeTestJSON-533995407 tempest-ImagesOneServerNegativeTestJSON-533995407-project-member] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 832.838213] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 832.838287] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.838402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.838468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.839288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.839288] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.839288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.839288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.841602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.841690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.841757] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.181489] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: SUCCESS [ 833.181744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.182404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.182404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.182404] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.182574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.182574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.182764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.182867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.182987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.183177] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.183294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.183372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.183556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.185658] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.185658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.185658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.185658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.185658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.185658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.185658] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.218176] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 36befdad-9fc8-4f96-b08c-86648732bf9c with status ACTIVE [ 833.218441] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.218869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.218949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.219347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.219347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.219439] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.220110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.220110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.220110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.220110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.220110] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.220110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.220110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.220600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.220600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.220600] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 36befdad-9fc8-4f96-b08c-86648732bf9c is going to be updated. [ 833.243732] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.243732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.243964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.243964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.244129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.244294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-36befdad-9fc8-4f96-b08c-86648732bf9c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.335557] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 833.335557] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 deletion is rescheduled due to dependency. [ 833.335557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.346189] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.346390] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.346466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.346678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.346766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.347173] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.347299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.347369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.347586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.347586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.347715] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be updated. [ 833.395713] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.395868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.395944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.396180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.396328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.418019] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: IN_PROGRESS for 2s [ 833.570200] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: SUCCESS [ 833.570418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.570583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.570810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.571009] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.571139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.571244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.571359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.571449] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.571567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.571620] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.572514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.573765] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.573984] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.574116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.574183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.574334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.574416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.574511] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.688409] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 09ad0af4-47bb-47f8-a343-07c0b9be11a8: rpc.has_security_group_logging(os_id): False [ 833.715845] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.715845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.715845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.715845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.715845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.715845] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.715845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.715845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.716852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.716852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.716852] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.716852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.716852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.716852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.716852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.716852] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.717218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.717218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.717218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.717218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.717401] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 is going to be created. [ 833.794650] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.794650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.794650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.794650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.794650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.811054] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: IN_PROGRESS for 2s [ 834.077457] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.077625] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.077841] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.580231] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.083268] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.083552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.083552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.084176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.084176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.084176] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 is going to be updated. [ 835.119269] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.119269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.119269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.119619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.119819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.128992] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: IN_PROGRESS for 2s [ 835.353162] env[67003]: INFO networking_nsxv3.common.synchronization [req-a17e4dd6-b22a-49ea-a802-b804450f7591 req-7a15bf31-d0db-4424-aa7f-a7485f6bb30c tempest-ListImageFiltersTestJSON-522016889 tempest-ListImageFiltersTestJSON-522016889-project-member] Enqueued Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_members [ 835.353815] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_members [ 835.354263] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.354323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.354416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.354906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.354906] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.354906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.355142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.355142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.355239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.355360] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.431473] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: SUCCESS [ 835.431729] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a deletion is rescheduled due to dependency. [ 835.431891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.825452] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: SUCCESS [ 835.825699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.825894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.827199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.827540] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.857760] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.329901] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.330446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.330446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.330446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.330878] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.330986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.331060] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.331242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.331422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.331595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.331673] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.361161] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.834866] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.835252] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.835392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.835750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.836028] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.836189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.836294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.836590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.836780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.836873] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.837243] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.837437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.837587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.837806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.838020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.838827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.838827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.839021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.839157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.839360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.839517] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.864693] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.864958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.865051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.865310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.865394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.865459] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a is going to be updated. [ 836.903476] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.903693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.903770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.904960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.905187] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.916854] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: IN_PROGRESS for 2s [ 837.141793] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: SUCCESS [ 837.142097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.142328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.142572] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.142795] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.142946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.143030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.143204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.143313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.143462] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.342495] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 09ad0af4-47bb-47f8-a343-07c0b9be11a8: rpc.has_security_group_logging(os_id): False [ 837.360757] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.360906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.360978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.361208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.361294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.361493] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.362272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.362272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.362272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.362272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.362272] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.362272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.362272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.362648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.362648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.362648] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.362774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.362873] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.363038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.363121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.363209] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 is going to be updated. [ 837.426319] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.426658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.426822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.427126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.427800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.445304] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: IN_PROGRESS for 2s [ 837.648557] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.152305] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.653917] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.657267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.657267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.657267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.657267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.657267] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 is going to be updated. [ 838.685523] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.685523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.685523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.685523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.685523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.693730] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: IN_PROGRESS for 2s [ 838.926473] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: SUCCESS [ 838.926720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.460089] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: SUCCESS [ 839.460313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.568035] env[67003]: INFO networking_nsxv3.common.synchronization [req-d76ec834-8cc8-477c-801d-20fd2254fd57 req-8a9efbc4-902c-4362-bf97-e8fbd14fe885 tempest-ListServersNegativeTestJSON-1594397262 tempest-ListServersNegativeTestJSON-1594397262-project-member] Enqueued Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 839.568318] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 839.568885] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.568885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.842291] env[67003]: INFO networking_nsxv3.common.synchronization [None req-95d31d3b-b063-4a07-b0c2-c282c900b509 None None] Enqueued Resource ID: e0745d09-9962-4f7e-9084-dc9704ad2fa6 with Priority: HIGHEST for action port [ 839.842291] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0745d09-9962-4f7e-9084-dc9704ad2fa6 with Priority: HIGHEST for action port [ 839.842291] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0745d09-9962-4f7e-9084-dc9704ad2fa6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.842291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0745d09-9962-4f7e-9084-dc9704ad2fa6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.842291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0745d09-9962-4f7e-9084-dc9704ad2fa6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.842291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0745d09-9962-4f7e-9084-dc9704ad2fa6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.842291] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0745d09-9962-4f7e-9084-dc9704ad2fa6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.929019] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-311 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.929019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-311" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.929019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-311" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.929019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-311" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.929019] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.929696] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.930490] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.933457] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.933457] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.933457] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.933457] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.933457] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.933457] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.933457] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.933457] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.933457] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.953924] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.953924] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 839.957020] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.957020] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-311" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.957020] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-17c30d2d-51b7-4649-9268-5684bb75edfc taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.957020] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-17c30d2d-51b7-4649-9268-5684bb75edfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.957020] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-17c30d2d-51b7-4649-9268-5684bb75edfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.957020] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-17c30d2d-51b7-4649-9268-5684bb75edfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.957020] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17c30d2d-51b7-4649-9268-5684bb75edfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.345230] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e0745d09-9962-4f7e-9084-dc9704ad2fa6 [ 840.345508] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.346752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.346752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.346752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.346752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.346752] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e0745d09-9962-4f7e-9084-dc9704ad2fa6 already deleted. [ 840.346752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0745d09-9962-4f7e-9084-dc9704ad2fa6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.459450] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.459778] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.459950] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.460301] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.460506] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.461296] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 17c30d2d-51b7-4649-9268-5684bb75edfc not found, creating... [ 840.461296] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.461296] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.461816] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.461816] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.462094] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.462535] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.462995] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.463439] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.464614] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.464614] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.464614] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 17c30d2d-51b7-4649-9268-5684bb75edfc is going to be created. [ 840.486280] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.486502] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.486634] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.486910] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.487242] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.487436] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-17c30d2d-51b7-4649-9268-5684bb75edfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.704867] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: IN_PROGRESS for 4s [ 841.221826] env[67003]: INFO networking_nsxv3.common.synchronization [req-d76ec834-8cc8-477c-801d-20fd2254fd57 req-974bb748-b3c5-4315-b02b-f0c053a3a8a7 service nova] Enqueued Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_rules [ 841.221826] env[67003]: INFO networking_nsxv3.common.synchronization [req-d76ec834-8cc8-477c-801d-20fd2254fd57 req-974bb748-b3c5-4315-b02b-f0c053a3a8a7 service nova] Enqueued Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 841.222158] env[67003]: INFO networking_nsxv3.common.synchronization [req-d76ec834-8cc8-477c-801d-20fd2254fd57 req-974bb748-b3c5-4315-b02b-f0c053a3a8a7 service nova] Enqueued Resource ID: 17c30d2d-51b7-4649-9268-5684bb75edfc with Priority: HIGHEST for action port [ 841.223157] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_rules [ 841.223346] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 841.223486] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17c30d2d-51b7-4649-9268-5684bb75edfc with Priority: HIGHEST for action port [ 841.224061] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.224061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.224310] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.224406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.224591] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-17c30d2d-51b7-4649-9268-5684bb75edfc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.224738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17c30d2d-51b7-4649-9268-5684bb75edfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.224738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17c30d2d-51b7-4649-9268-5684bb75edfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.225226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17c30d2d-51b7-4649-9268-5684bb75edfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.225300] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17c30d2d-51b7-4649-9268-5684bb75edfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.727715] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17c30d2d-51b7-4649-9268-5684bb75edfc with status ACTIVE [ 841.727952] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.728199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.728287] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.728541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.728640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.728842] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.728948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.729043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.729177] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.729256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.729433] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.729536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.729588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.729778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.729862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.730082] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17c30d2d-51b7-4649-9268-5684bb75edfc is going to be updated. [ 841.760053] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.760053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.760053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.760053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.760053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.760745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17c30d2d-51b7-4649-9268-5684bb75edfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.183685] env[67003]: INFO networking_nsxv3.common.synchronization [req-66dce070-5373-41f0-abea-3f192ae1b1bb req-bba65169-4b6b-497d-a17f-122c3bc13ac1 tempest-ListServerFiltersTestJSON-449543784 tempest-ListServerFiltersTestJSON-449543784-project-member] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 842.186550] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 842.186845] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.186956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.187164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.187238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.187368] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.187469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.187538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.187677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.187760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.187851] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.270797] env[67003]: INFO networking_nsxv3.common.synchronization [None req-7929f886-d546-497e-943f-b521e7f8a3ed None None] Enqueued Resource ID: 2dc7a653-e56b-4e75-9e46-a40162fd1375 with Priority: HIGHEST for action port [ 842.271422] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2dc7a653-e56b-4e75-9e46-a40162fd1375 with Priority: HIGHEST for action port [ 842.271779] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2dc7a653-e56b-4e75-9e46-a40162fd1375 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.271902] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2dc7a653-e56b-4e75-9e46-a40162fd1375" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.271969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2dc7a653-e56b-4e75-9e46-a40162fd1375" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.272253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2dc7a653-e56b-4e75-9e46-a40162fd1375" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.272371] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2dc7a653-e56b-4e75-9e46-a40162fd1375',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.511045] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-108 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.511045] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-108" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.511045] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-108" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.511045] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-108" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.511333] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.511333] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.511428] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.511646] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.511780] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.511982] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.512108] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 842.512217] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 842.512322] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 842.512429] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 842.512531] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 842.512666] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 842.532164] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 842.532329] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 842.532474] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 842.532660] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-108" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.533018] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-2ac1ecc9-9829-4152-9eaf-e822795b91ee taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.533207] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-2ac1ecc9-9829-4152-9eaf-e822795b91ee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.533327] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-2ac1ecc9-9829-4152-9eaf-e822795b91ee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.533656] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-2ac1ecc9-9829-4152-9eaf-e822795b91ee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.533791] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ac1ecc9-9829-4152-9eaf-e822795b91ee',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.690659] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.722179] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: SUCCESS [ 842.722399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.722559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.722769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.723054] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.723187] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.723243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.723405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.723484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.723571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.723741] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.723820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.723880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.724062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.724209] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.724313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.724375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.724496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.724570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.724659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.724739] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.725628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.725789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.725940] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.726093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.726142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.726242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.726307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.726405] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.774588] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2dc7a653-e56b-4e75-9e46-a40162fd1375 [ 842.774822] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.775176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.775274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.775544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.775641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.775745] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2dc7a653-e56b-4e75-9e46-a40162fd1375 already deleted. [ 842.775827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2dc7a653-e56b-4e75-9e46-a40162fd1375" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.037140] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.037455] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.037589] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.037940] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.038148] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.038329] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 2ac1ecc9-9829-4152-9eaf-e822795b91ee not found, creating... [ 843.038634] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.038824] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.038961] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.039246] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.039398] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.039714] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.039875] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.039994] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.040280] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.040451] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.040613] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 2ac1ecc9-9829-4152-9eaf-e822795b91ee is going to be created. [ 843.074425] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.074568] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.074679] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.075017] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.075307] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.075548] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-2ac1ecc9-9829-4152-9eaf-e822795b91ee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.192761] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.229185] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eda6bee5-9b5c-4b6f-888f-231f9c7282b1: rpc.has_security_group_logging(os_id): False [ 843.230280] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.266033] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.266301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.266301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.266591] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.266686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.266904] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.267021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.267087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.267709] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.267709] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.267709] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.267855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.267855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.267932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.268033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.268214] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.268493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.268749] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.268749] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.268839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.268932] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 is going to be created. [ 843.354938] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.355383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.355383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.355473] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.356048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.370742] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: IN_PROGRESS for 2s [ 843.698261] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.698261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.698261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.698261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.698261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.698261] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 is going to be updated. [ 843.730483] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.730483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.730483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.730483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.730483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.734685] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.739770] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: IN_PROGRESS for 2s [ 843.776489] env[67003]: INFO networking_nsxv3.common.synchronization [req-66dce070-5373-41f0-abea-3f192ae1b1bb req-7f7fef53-8a54-476b-9b72-44fbb8779cca service nova] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_rules [ 843.776681] env[67003]: INFO networking_nsxv3.common.synchronization [req-66dce070-5373-41f0-abea-3f192ae1b1bb req-7f7fef53-8a54-476b-9b72-44fbb8779cca service nova] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 843.776824] env[67003]: INFO networking_nsxv3.common.synchronization [req-66dce070-5373-41f0-abea-3f192ae1b1bb req-7f7fef53-8a54-476b-9b72-44fbb8779cca service nova] Enqueued Resource ID: 2ac1ecc9-9829-4152-9eaf-e822795b91ee with Priority: HIGHEST for action port [ 843.777962] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_rules [ 843.778193] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 843.778232] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ac1ecc9-9829-4152-9eaf-e822795b91ee with Priority: HIGHEST for action port [ 843.778516] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.778642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.778704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.778909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.778991] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.780528] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.780740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.780850] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2ac1ecc9-9829-4152-9eaf-e822795b91ee taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.780937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2ac1ecc9-9829-4152-9eaf-e822795b91ee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.780977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2ac1ecc9-9829-4152-9eaf-e822795b91ee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.781171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2ac1ecc9-9829-4152-9eaf-e822795b91ee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.781249] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2ac1ecc9-9829-4152-9eaf-e822795b91ee',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.236952] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.237138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.237290] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.237478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.237572] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.237684] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 is going to be updated. [ 844.271739] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.271936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.271936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.272304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.272515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.281494] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.281644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.282478] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: IN_PROGRESS for 2s [ 844.283850] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2ac1ecc9-9829-4152-9eaf-e822795b91ee with status ACTIVE [ 844.284050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.284219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.284374] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.284564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.284657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.284839] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.285020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.285077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.285241] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.285320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.285504] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.285603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.285664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.285802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.285875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.286087] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2ac1ecc9-9829-4152-9eaf-e822795b91ee is going to be updated. [ 844.319274] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.319474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.319636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.320021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.320258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.320556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2ac1ecc9-9829-4152-9eaf-e822795b91ee" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.385800] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: SUCCESS [ 845.385800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.385800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.385800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.385800] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.753341] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: SUCCESS [ 845.753341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.753341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.753341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.753341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.753341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.753341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.753757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.753951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.754210] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.888300] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.888513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.256518] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.296430] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: SUCCESS [ 846.297357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.297357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.297357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.297601] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.297690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.297800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.298305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.298305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.298305] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.458351] env[67003]: INFO networking_nsxv3.common.synchronization [None req-2f6fc5b3-e2b4-437b-b5c9-93c6e3cb516d tempest-ServerActionsTestJSON-1949922754 tempest-ServerActionsTestJSON-1949922754-project-member] Enqueued Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGHEST for action security_group_rules [ 846.458952] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGHEST for action security_group_rules [ 846.459773] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-993ce117-521f-4677-9ad6-2a219a7366c9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.460752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.460752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.460752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.460752] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.549940] env[67003]: INFO networking_nsxv3.common.synchronization [None req-cabdfc15-4874-46b9-8a55-59c60395f8f6 tempest-ServerActionsTestJSON-1949922754 tempest-ServerActionsTestJSON-1949922754-project-member] Enqueued Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGHEST for action security_group_rules [ 846.550541] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGHEST for action security_group_rules [ 846.550794] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-993ce117-521f-4677-9ad6-2a219a7366c9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.550896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.762470] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.801162] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.984729] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.984981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.984981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.985242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.985342] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.985444] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 993ce117-521f-4677-9ad6-2a219a7366c9 already deleted. [ 846.985530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.985691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.985870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.985978] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.263972] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.264204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.264204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.264559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.264559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.264638] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 is going to be updated. [ 847.305025] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.306882] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.307033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.307100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.307366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.307428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.318453] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: IN_PROGRESS for 2s [ 847.509194] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.509493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.509493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.509607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.509728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.509777] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 993ce117-521f-4677-9ad6-2a219a7366c9 already deleted. [ 847.509861] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.810069] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.810269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.810317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.810525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.810622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.810731] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 is going to be updated. [ 847.843760] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.843916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.843995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.844196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.844347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.852868] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: IN_PROGRESS for 2s [ 849.328595] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: SUCCESS [ 849.328970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.328970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.329210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.329398] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.329551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.329671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.329745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.329823] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.329906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.329997] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.833110] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.833110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.833343] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.833515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.833696] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.833812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.833906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.834103] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.834240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.835852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.835852] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.835852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.835852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.835852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.835852] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.835852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.835852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.835852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.835852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.835852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.835852] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.864578] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: SUCCESS [ 849.864918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.865174] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.865415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.865609] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.865724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.865789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.865964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.866039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.866164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.866280] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.337988] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 09ad0af4-47bb-47f8-a343-07c0b9be11a8: rpc.has_security_group_logging(os_id): False [ 850.357347] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.357616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.357616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.357808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.357911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.358111] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.358210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.358269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.358464] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.358565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.358768] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.358941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.359020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.359204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.359340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.359610] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.359747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.359843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.359994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.360092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.360180] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 is going to be updated. [ 850.369178] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.369322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.369396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.369599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.369765] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.369864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.369928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.370084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.370168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.370254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.370397] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.370491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.370553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.370696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.370834] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.370922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.370984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.371131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.371203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.371282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.371368] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.423415] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.423566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.423604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.423865] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.424052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.440932] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: IN_PROGRESS for 2s [ 850.873706] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eda6bee5-9b5c-4b6f-888f-231f9c7282b1: rpc.has_security_group_logging(os_id): False [ 850.895925] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.896086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.896086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.896284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.896366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.897247] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.897247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.897247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.897247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.897247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.897247] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.897247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.897247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.897602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.897602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.897665] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.897770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.897770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.897911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.897986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.898082] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 is going to be updated. [ 850.976650] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.976825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.976864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.977092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.977237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.990027] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: IN_PROGRESS for 2s [ 851.551992] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 851.552296] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 852.456128] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: SUCCESS [ 852.456411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.004650] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: SUCCESS [ 853.005205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.005205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.005523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.005658] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.510347] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.510570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.510687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.510973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.511222] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.511492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.511492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.511639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.511752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.511905] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.512069] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.014309] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.014573] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.014573] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.014733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.014905] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.015059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.015105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.015248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.015332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.015420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.015569] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.015870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.015870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.015870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.015996] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.016127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.016193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.016335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.016409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.016490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.016577] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.331199] env[67003]: INFO networking_nsxv3.common.synchronization [req-33e60919-cc1b-4f10-9a00-85b17201d21b req-86b91a9b-9f38-49d0-bc7f-12552d3eeeac tempest-ListServersNegativeTestJSON-1594397262 tempest-ListServersNegativeTestJSON-1594397262-project-member] Enqueued Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 854.332147] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 854.332147] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.332307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.332307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.332441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.332722] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.332722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.332849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.332963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.333019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.333097] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.521191] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eda6bee5-9b5c-4b6f-888f-231f9c7282b1: rpc.has_security_group_logging(os_id): False [ 854.540497] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.540497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.540497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.540497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.540497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.540497] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.540830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.540830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.540893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.541010] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.541177] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.541291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.541366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.541507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.541578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.541786] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.541875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.541946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.542356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.542450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.542545] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 is going to be updated. [ 854.608018] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.608206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.608279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.608510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.608669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.622814] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: IN_PROGRESS for 2s [ 854.835666] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.338939] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.841344] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.841543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.841582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.841785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.841870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.841970] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 is going to be updated. [ 855.870203] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.870386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.870427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.870612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.870756] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.880737] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: IN_PROGRESS for 2s [ 856.640063] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: SUCCESS [ 856.640337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.891564] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: SUCCESS [ 857.891865] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.332533] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 859.332860] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 859.820829] env[67003]: INFO networking_nsxv3.common.synchronization [req-e907bd6e-7677-4a09-b24f-07114b522b18 req-1f50939d-6393-41ac-993a-3e0bd52a1a36 tempest-ServersWithSpecificFlavorTestJSON-1477718790 tempest-ServersWithSpecificFlavorTestJSON-1477718790-project-member] Enqueued Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_members [ 859.823047] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_members [ 859.823047] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.823047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.823047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.823047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.823047] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.823047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.823047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.823047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.823047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.823047] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.165755] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-479 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.165962] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-479" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.166126] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-479" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.166405] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-479" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.166671] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.166828] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.166947] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.167390] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.167551] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.167770] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.167886] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 860.168075] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 860.168202] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 860.168314] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 860.169078] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 860.169374] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 860.189662] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 860.189808] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 860.189927] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 860.190154] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-479" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.190923] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-bba0f6fc-5929-47d2-b0f8-12feb84c7c5a taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.191121] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-bba0f6fc-5929-47d2-b0f8-12feb84c7c5a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.191246] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-bba0f6fc-5929-47d2-b0f8-12feb84c7c5a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.191570] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-bba0f6fc-5929-47d2-b0f8-12feb84c7c5a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.191709] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bba0f6fc-5929-47d2-b0f8-12feb84c7c5a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.326078] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.326263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.326350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.326563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.326652] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.326854] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.326951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.327029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.327176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.327256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.327383] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 is going to be deleted. [ 860.355910] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.356284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.356284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.356368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.356406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.356489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.694121] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.694387] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.694521] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.694799] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.694981] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.695252] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port bba0f6fc-5929-47d2-b0f8-12feb84c7c5a not found, creating... [ 860.695510] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.695669] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.695786] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.696025] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.696197] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.696514] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.696704] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.696848] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.697074] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.697215] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.697395] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: bba0f6fc-5929-47d2-b0f8-12feb84c7c5a is going to be created. [ 860.718773] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.719026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.719204] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.719519] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.719798] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.720073] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-bba0f6fc-5929-47d2-b0f8-12feb84c7c5a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.450338] env[67003]: INFO networking_nsxv3.common.synchronization [req-e907bd6e-7677-4a09-b24f-07114b522b18 req-fb0ff32f-c7e9-43b6-8be0-6aa76ed3be11 service nova] Enqueued Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_rules [ 861.450593] env[67003]: INFO networking_nsxv3.common.synchronization [req-e907bd6e-7677-4a09-b24f-07114b522b18 req-fb0ff32f-c7e9-43b6-8be0-6aa76ed3be11 service nova] Enqueued Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_members [ 861.450671] env[67003]: INFO networking_nsxv3.common.synchronization [req-e907bd6e-7677-4a09-b24f-07114b522b18 req-fb0ff32f-c7e9-43b6-8be0-6aa76ed3be11 service nova] Enqueued Resource ID: bba0f6fc-5929-47d2-b0f8-12feb84c7c5a with Priority: HIGHEST for action port [ 861.450892] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_rules [ 861.451027] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_members [ 861.451125] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bba0f6fc-5929-47d2-b0f8-12feb84c7c5a with Priority: HIGHEST for action port [ 861.451713] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.451790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.451833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.452207] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.452312] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.453236] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.453376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.453451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.454539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.454539] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.454539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.454539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.454539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.454539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.454539] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.456864] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-bba0f6fc-5929-47d2-b0f8-12feb84c7c5a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.457852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bba0f6fc-5929-47d2-b0f8-12feb84c7c5a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.457852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bba0f6fc-5929-47d2-b0f8-12feb84c7c5a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.457852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bba0f6fc-5929-47d2-b0f8-12feb84c7c5a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.457852] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bba0f6fc-5929-47d2-b0f8-12feb84c7c5a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.959462] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.960612] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.960752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.963615] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bba0f6fc-5929-47d2-b0f8-12feb84c7c5a with status ACTIVE [ 861.963813] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.964193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.964292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.964521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.964614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.964797] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.964899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.964963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.965157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.965238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.965417] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.965573] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.965573] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.965700] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.965773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.965858] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bba0f6fc-5929-47d2-b0f8-12feb84c7c5a is going to be updated. [ 861.989057] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.989057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.989057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.989628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.990033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.990033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bba0f6fc-5929-47d2-b0f8-12feb84c7c5a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.463206] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.971246] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.971246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.971246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.971246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.971246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.971246] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 is going to be created. [ 862.997262] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.997512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.997512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.997673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.997834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.008127] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24c47389-894a-46a4-ac4e-16c5bd995856 in Status: UNINITIALIZED for 2s [ 863.342462] env[67003]: INFO networking_nsxv3.common.synchronization [None req-2137e9b6-382a-434d-bdc4-259bad9e2a94 None None] Enqueued Resource ID: 29f486f1-91f5-4f36-ab7e-be49ecca4cb9 with Priority: HIGHEST for action port [ 863.343117] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29f486f1-91f5-4f36-ab7e-be49ecca4cb9 with Priority: HIGHEST for action port [ 863.343565] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-29f486f1-91f5-4f36-ab7e-be49ecca4cb9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.343713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29f486f1-91f5-4f36-ab7e-be49ecca4cb9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.343776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29f486f1-91f5-4f36-ab7e-be49ecca4cb9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.344137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29f486f1-91f5-4f36-ab7e-be49ecca4cb9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.344233] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29f486f1-91f5-4f36-ab7e-be49ecca4cb9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.847269] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29f486f1-91f5-4f36-ab7e-be49ecca4cb9 [ 863.847658] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.847811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.847879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.848406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.849149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.849149] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29f486f1-91f5-4f36-ab7e-be49ecca4cb9 already deleted. [ 863.849149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29f486f1-91f5-4f36-ab7e-be49ecca4cb9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.494074] env[67003]: INFO networking_nsxv3.common.synchronization [req-545f8807-d709-425a-811e-4bb9c7300df2 req-e302e2a5-9456-42be-abf3-24ed7512dafe tempest-ServersAdminNegativeTestJSON-1891119767 tempest-ServersAdminNegativeTestJSON-1891119767-project-member] Enqueued Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_members [ 864.494651] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_members [ 864.494963] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.497189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.497282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.497479] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.497653] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.497761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.497824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.497984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.498082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.498180] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.836773] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.837500] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.837633] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.837901] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.838464] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.839618] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.839618] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.839618] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.839618] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.839805] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.839867] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.839976] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.840099] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.841240] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.841240] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.841240] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.862726] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.863027] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 864.863096] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.863271] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.863612] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-bf251741-1519-453f-b552-f7c83c2e11be taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.863792] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-bf251741-1519-453f-b552-f7c83c2e11be" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.863908] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-bf251741-1519-453f-b552-f7c83c2e11be" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.864257] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-bf251741-1519-453f-b552-f7c83c2e11be" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.864395] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf251741-1519-453f-b552-f7c83c2e11be',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.000653] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.019503] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24c47389-894a-46a4-ac4e-16c5bd995856 in Status: SUCCESS [ 865.019772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.019935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.020205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.020397] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.020513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.020578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.020728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.020805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.020888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.020976] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.367270] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.367576] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.367705] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.367969] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.368134] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.368290] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port bf251741-1519-453f-b552-f7c83c2e11be not found, creating... [ 865.368596] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.368746] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.368791] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.369008] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.369155] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.369441] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.369599] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.369711] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.369914] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.374995] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.375269] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: bf251741-1519-453f-b552-f7c83c2e11be is going to be created. [ 865.395448] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.395676] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.395794] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.396074] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.396359] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.396565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-bf251741-1519-453f-b552-f7c83c2e11be" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.505559] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.526620] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.606531] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e8af5d9e-3c64-4c28-a0ab-fb91651abcca None None] Enqueued Resource ID: 9d4cd5ac-4139-45b9-8822-fe9111403848 with Priority: HIGHEST for action port [ 865.606818] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d4cd5ac-4139-45b9-8822-fe9111403848 with Priority: HIGHEST for action port [ 865.607565] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d4cd5ac-4139-45b9-8822-fe9111403848 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.607565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d4cd5ac-4139-45b9-8822-fe9111403848" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.607565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d4cd5ac-4139-45b9-8822-fe9111403848" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.607813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d4cd5ac-4139-45b9-8822-fe9111403848" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.607813] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d4cd5ac-4139-45b9-8822-fe9111403848',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.008651] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.010271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.010271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.010271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.010271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.010271] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc is going to be updated. [ 866.030314] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 24c47389-894a-46a4-ac4e-16c5bd995856: rpc.has_security_group_logging(os_id): False [ 866.048156] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.048260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.048446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.048834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.049076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.051057] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.051201] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.051250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.051481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.051689] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.051826] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.051938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.052033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.052628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.052628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.052628] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 is going to be created. [ 866.063564] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: IN_PROGRESS for 2s [ 866.110265] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d4cd5ac-4139-45b9-8822-fe9111403848 [ 866.110697] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.110909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.111039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.111355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.111511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.111697] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d4cd5ac-4139-45b9-8822-fe9111403848 already deleted. [ 866.111848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d4cd5ac-4139-45b9-8822-fe9111403848" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.118221] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.118523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.118610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.118863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.119120] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.134280] env[67003]: INFO networking_nsxv3.common.synchronization [req-545f8807-d709-425a-811e-4bb9c7300df2 req-a1bbb73e-b118-41e8-ad79-fd72fad9f229 service nova] Enqueued Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_rules [ 866.134368] env[67003]: INFO networking_nsxv3.common.synchronization [req-545f8807-d709-425a-811e-4bb9c7300df2 req-a1bbb73e-b118-41e8-ad79-fd72fad9f229 service nova] Enqueued Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_members [ 866.134501] env[67003]: INFO networking_nsxv3.common.synchronization [req-545f8807-d709-425a-811e-4bb9c7300df2 req-a1bbb73e-b118-41e8-ad79-fd72fad9f229 service nova] Enqueued Resource ID: bf251741-1519-453f-b552-f7c83c2e11be with Priority: HIGHEST for action port [ 866.135752] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24c47389-894a-46a4-ac4e-16c5bd995856 in Status: IN_PROGRESS for 2s [ 866.136314] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_rules [ 866.136506] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_members [ 866.136613] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf251741-1519-453f-b552-f7c83c2e11be with Priority: HIGHEST for action port [ 866.136955] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.137227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.137227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.137351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.137412] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.138386] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.138513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.138768] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf251741-1519-453f-b552-f7c83c2e11be taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.138914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf251741-1519-453f-b552-f7c83c2e11be" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.139017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf251741-1519-453f-b552-f7c83c2e11be" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.139174] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf251741-1519-453f-b552-f7c83c2e11be" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.139249] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf251741-1519-453f-b552-f7c83c2e11be',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.641816] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.641920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.642182] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf251741-1519-453f-b552-f7c83c2e11be with status ACTIVE [ 866.642320] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.642455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.642508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.642693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.642777] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.642944] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.643048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.643108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.643294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.643412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.643531] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.643621] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.643681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.644290] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.644402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.644496] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf251741-1519-453f-b552-f7c83c2e11be is going to be updated. [ 866.668244] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.669368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.669368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.669368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.669368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.669681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf251741-1519-453f-b552-f7c83c2e11be" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.120812] env[67003]: INFO networking_nsxv3.common.synchronization [req-bd5e9f5a-5d4f-4af1-b6cd-6d2af784d5cb req-8b2cf22f-96bb-4f20-8700-e93486e9ceb4 tempest-ServersTestJSON-1317110385 tempest-ServersTestJSON-1317110385-project-member] Enqueued Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGHEST for action security_group_members [ 867.121609] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGHEST for action security_group_members [ 867.122068] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc0841b-286c-4904-bf0d-135e41f2566e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.122246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.122347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.122697] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.123326] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.123326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.123326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.123488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.124034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.124034] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc0841b-286c-4904-bf0d-135e41f2566e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.480279] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-827 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.480480] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-827" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.480602] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-827" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.480929] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-827" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.481243] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.481444] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.481594] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.481814] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.481959] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.482391] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.482724] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 867.482842] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 867.482950] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 867.483075] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 867.483255] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 867.483451] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 867.504522] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 867.504655] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 867.504742] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 867.504894] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-827" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.505309] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-62e0ee95-0cea-4840-b944-fe98838cc59b taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.505505] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-62e0ee95-0cea-4840-b944-fe98838cc59b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.505596] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-62e0ee95-0cea-4840-b944-fe98838cc59b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.506188] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-62e0ee95-0cea-4840-b944-fe98838cc59b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.506188] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62e0ee95-0cea-4840-b944-fe98838cc59b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.627246] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.627411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.627507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.627724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.627813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.628026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.628135] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.628197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.628342] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.628416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.628500] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc0841b-286c-4904-bf0d-135e41f2566e already deleted. [ 867.628593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.008816] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.009183] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.009336] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.009761] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.009933] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.010121] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 62e0ee95-0cea-4840-b944-fe98838cc59b not found, creating... [ 868.010498] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.010718] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.010884] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.011222] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.011438] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.011820] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.012061] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.012229] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.012544] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.012700] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.012904] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 62e0ee95-0cea-4840-b944-fe98838cc59b is going to be created. [ 868.036306] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.036563] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.036679] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.036977] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.037255] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.037544] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-62e0ee95-0cea-4840-b944-fe98838cc59b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.074201] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: SUCCESS [ 868.074464] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.074603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.074962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.075266] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.075450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.075518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.075706] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.075835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.075987] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.156844] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 24c47389-894a-46a4-ac4e-16c5bd995856 in Status: SUCCESS [ 868.157246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.578517] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.755316] env[67003]: INFO networking_nsxv3.common.synchronization [req-bd5e9f5a-5d4f-4af1-b6cd-6d2af784d5cb req-9f9b1415-8298-4eb3-8191-9d9e2a921606 service nova] Enqueued Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGHEST for action security_group_rules [ 868.755316] env[67003]: INFO networking_nsxv3.common.synchronization [req-bd5e9f5a-5d4f-4af1-b6cd-6d2af784d5cb req-9f9b1415-8298-4eb3-8191-9d9e2a921606 service nova] Enqueued Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGHEST for action security_group_members [ 868.755316] env[67003]: INFO networking_nsxv3.common.synchronization [req-bd5e9f5a-5d4f-4af1-b6cd-6d2af784d5cb req-9f9b1415-8298-4eb3-8191-9d9e2a921606 service nova] Enqueued Resource ID: 62e0ee95-0cea-4840-b944-fe98838cc59b with Priority: HIGHEST for action port [ 868.755316] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGHEST for action security_group_rules [ 868.755316] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGHEST for action security_group_members [ 868.755316] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62e0ee95-0cea-4840-b944-fe98838cc59b with Priority: HIGHEST for action port [ 868.756589] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc0841b-286c-4904-bf0d-135e41f2566e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.756854] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.757041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.757358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.757565] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc0841b-286c-4904-bf0d-135e41f2566e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.761765] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc0841b-286c-4904-bf0d-135e41f2566e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.761872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.761970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.762214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.762374] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.762480] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.762555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.762736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.762792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.762908] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc0841b-286c-4904-bf0d-135e41f2566e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.765373] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-62e0ee95-0cea-4840-b944-fe98838cc59b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.765373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62e0ee95-0cea-4840-b944-fe98838cc59b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.765526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62e0ee95-0cea-4840-b944-fe98838cc59b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.765753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62e0ee95-0cea-4840-b944-fe98838cc59b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.765883] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62e0ee95-0cea-4840-b944-fe98838cc59b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.975025] env[67003]: INFO networking_nsxv3.common.synchronization [req-d9c0e283-fccb-4837-ba5e-f36d4fc03730 req-08025e9e-91b9-4328-b32f-510c33e11fd4 tempest-ServersAdminTestJSON-1432619756 tempest-ServersAdminTestJSON-1432619756-project-member] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 868.975565] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 868.975876] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.976688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.976688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.976688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.976688] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.976688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.976688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.976943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.976943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.976943] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.082308] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.271704] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3cc0841b-286c-4904-bf0d-135e41f2566e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.273023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc0841b-286c-4904-bf0d-135e41f2566e taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.273213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.273669] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 62e0ee95-0cea-4840-b944-fe98838cc59b with status ACTIVE [ 869.273924] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.274638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.274784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.274939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.275060] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.275334] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.275427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.275491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.275661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.276028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.276028] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.276149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.276149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.276304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.276374] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.276461] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 62e0ee95-0cea-4840-b944-fe98838cc59b is going to be updated. [ 869.300708] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.300708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.300708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.301943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.301943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.301943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62e0ee95-0cea-4840-b944-fe98838cc59b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.364661] env[67003]: INFO networking_nsxv3.common.synchronization [req-94b8f22d-eac6-4183-a561-7bde81616560 req-2a2bf829-86e9-471b-99d3-abcb5f8cb961 tempest-ListServerFiltersTestJSON-449543784 tempest-ListServerFiltersTestJSON-449543784-project-member] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 869.365427] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 869.366125] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.366125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.366125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.366125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.366357] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.366357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.366357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.366472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.366565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.366676] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.481235] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.586982] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.586982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.586982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.586982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.586982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.586982] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc is going to be updated. [ 869.623645] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.623645] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.623645] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.623899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.623977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.638167] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: IN_PROGRESS for 2s [ 869.774862] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3cc0841b-286c-4904-bf0d-135e41f2566e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.869666] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.984346] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.020600] env[67003]: INFO networking_nsxv3.common.synchronization [req-ed1db911-88ff-47b1-8962-ba35fcb577fa req-c8b275bf-fc31-4101-92ed-005aadbe28c7 tempest-ServersTestManualDisk-372424363 tempest-ServersTestManualDisk-372424363-project-member] Enqueued Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGHEST for action security_group_members [ 870.021149] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGHEST for action security_group_members [ 870.021457] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ed018b-2f29-4f20-913e-d07a9663638e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.021578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.021645] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.021903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.022229] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.022357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.022420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.022737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.022737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.022837] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11ed018b-2f29-4f20-913e-d07a9663638e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.281729] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.282164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.282164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.282338] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.282401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.282649] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc0841b-286c-4904-bf0d-135e41f2566e is going to be created. [ 870.311156] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.311345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.311444] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.311872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.311872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.322976] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc0841b-286c-4904-bf0d-135e41f2566e in Status: UNINITIALIZED for 2s [ 870.360397] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-259 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.360602] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-259" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.360602] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-259" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.360602] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-259" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.360602] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.360602] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.360602] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.360602] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.362203] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.362203] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.362271] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 870.362375] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 870.362512] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 870.362654] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 870.362764] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 870.364786] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 870.371788] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.388675] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 870.388675] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 870.388675] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 870.388675] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-259" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.388675] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.388675] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.388675] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.388675] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.388675] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.490223] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.490409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.490466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.490679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.490767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.490869] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 870.524410] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.524600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.524663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.527762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.527762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.527762] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.527762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.528092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.528092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.528092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.528297] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.528362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.528420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.528558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.528627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.528707] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ed018b-2f29-4f20-913e-d07a9663638e already deleted. [ 870.528783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.534686] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 870.877311] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.877311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.877311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.877311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.877311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.877311] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 is going to be updated. [ 870.893100] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.893100] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.893373] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.893438] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.893585] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.893738] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd not found, creating... [ 870.893998] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.894176] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.894297] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.894517] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.894811] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.895094] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.895307] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.895431] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.895647] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.895781] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.895920] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd is going to be created. [ 870.912104] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.912464] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.912464] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.912557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.912716] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.918748] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.918748] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.918748] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.918748] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.919845] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.920034] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.927240] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: IN_PROGRESS for 2s [ 871.637640] env[67003]: INFO networking_nsxv3.common.synchronization [req-ed1db911-88ff-47b1-8962-ba35fcb577fa req-5bd2bfe4-1b38-440d-af3f-4bc38a7140a9 service nova] Enqueued Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGHEST for action security_group_rules [ 871.637943] env[67003]: INFO networking_nsxv3.common.synchronization [req-ed1db911-88ff-47b1-8962-ba35fcb577fa req-5bd2bfe4-1b38-440d-af3f-4bc38a7140a9 service nova] Enqueued Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGHEST for action security_group_members [ 871.637943] env[67003]: INFO networking_nsxv3.common.synchronization [req-ed1db911-88ff-47b1-8962-ba35fcb577fa req-5bd2bfe4-1b38-440d-af3f-4bc38a7140a9 service nova] Enqueued Resource ID: 2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd with Priority: HIGHEST for action port [ 871.638342] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGHEST for action security_group_rules [ 871.638470] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGHEST for action security_group_members [ 871.638566] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd with Priority: HIGHEST for action port [ 871.639756] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11ed018b-2f29-4f20-913e-d07a9663638e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.639970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.640054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.640254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.640337] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11ed018b-2f29-4f20-913e-d07a9663638e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.641586] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ed018b-2f29-4f20-913e-d07a9663638e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.641688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.641773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.641924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.642157] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.642239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.642306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.642455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.642553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.642627] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11ed018b-2f29-4f20-913e-d07a9663638e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.643488] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.643626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.643626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.643790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.643863] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.654209] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: SUCCESS [ 871.654431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.654586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.654793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.654978] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.655107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.655211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.655353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.655434] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.655521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.655611] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.146561] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd with status ACTIVE [ 872.146800] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.146935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.147056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.147231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.147323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.147537] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.147651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.147716] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.147875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.148023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.148148] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.148246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.148308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.148447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.148528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.148616] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd is going to be updated. [ 872.149841] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('11ed018b-2f29-4f20-913e-d07a9663638e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.151088] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ed018b-2f29-4f20-913e-d07a9663638e taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.151189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.157299] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.157437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.157501] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.159473] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.159728] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.159848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.159915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.160109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.160193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.160311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.160488] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.160575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.160614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.160795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.160907] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.160995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.161123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.161238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.161312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.161431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.161490] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.175305] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.175414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.175454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.175646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.175787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.175945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e0f4a75-8fbe-438e-bf8d-3c08858aa5dd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.341145] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc0841b-286c-4904-bf0d-135e41f2566e in Status: SUCCESS [ 872.341145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.341145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.341453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.341529] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.341611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.341665] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.341820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.341903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.341983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.342089] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3cc0841b-286c-4904-bf0d-135e41f2566e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.507437] env[67003]: INFO networking_nsxv3.common.synchronization [req-dfbb83aa-d3f3-4960-87fe-08c33ef40dad req-feebd3f7-491d-4692-be18-9bcf11e21ce7 tempest-ServerRescueNegativeTestJSON-408866913 tempest-ServerRescueNegativeTestJSON-408866913-project-member] Enqueued Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_members [ 872.507437] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_members [ 872.507437] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.507437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.507437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.507437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.507437] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.507437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.507437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.507437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.507437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.507437] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.547996] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 872.548684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.652706] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('11ed018b-2f29-4f20-913e-d07a9663638e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.665370] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aecf3eb9-1ca3-4c5d-973b-4e11d36881cc: rpc.has_security_group_logging(os_id): False [ 872.685340] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.685614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.685776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.686037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.686183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.687610] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.687771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.687836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.688058] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.688170] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.688408] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.688525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.688589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.688739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.688816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.689013] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.691262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.691364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.691678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.691678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.691767] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc is going to be updated. [ 872.802493] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.802667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.802667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.802943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.803073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.829612] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: IN_PROGRESS for 2s [ 872.846611] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3cc0841b-286c-4904-bf0d-135e41f2566e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.938817] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: SUCCESS [ 872.939067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.010585] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.010787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.010880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.011163] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.011261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.011550] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.011619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.011664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.011806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.011883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.011967] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 already deleted. [ 873.012065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.016085] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-639 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.016300] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-639" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.016442] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-639" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.016796] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-639" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.017315] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.018130] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.018130] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.018130] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.018130] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.018329] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.018366] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 873.018517] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 873.018633] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 873.018740] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 873.018847] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 873.018976] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 873.041408] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 873.041593] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 873.041739] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 873.041952] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-639" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.042343] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.042527] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.042646] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.042988] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.043179] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.155508] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.155666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.155736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.155954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.156061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.156194] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ed018b-2f29-4f20-913e-d07a9663638e is going to be created. [ 873.180303] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.180824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.180918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.181203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.181340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.193152] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ed018b-2f29-4f20-913e-d07a9663638e in Status: UNINITIALIZED for 2s [ 873.352419] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3cc0841b-286c-4904-bf0d-135e41f2566e: rpc.has_security_group_logging(os_id): False [ 873.396985] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.397166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.397258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.397486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.397628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.397874] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.397985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.398056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.398233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.398324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.398448] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc0841b-286c-4904-bf0d-135e41f2566e is going to be created. [ 873.467862] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.468040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.468085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.468294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.468475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.480211] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc0841b-286c-4904-bf0d-135e41f2566e in Status: IN_PROGRESS for 2s [ 873.546156] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.546567] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.546718] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.547026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.547191] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.547449] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8 not found, creating... [ 873.547785] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.547957] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.548091] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.548332] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.548473] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.548766] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.548923] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.549055] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.549298] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.549433] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.549576] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8 is going to be created. [ 873.576470] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.576739] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.576868] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.577186] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.577414] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.577754] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.360583] env[67003]: INFO networking_nsxv3.common.synchronization [req-dfbb83aa-d3f3-4960-87fe-08c33ef40dad req-46fe12b6-8763-4c24-a135-340f3dd94ab8 service nova] Enqueued Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_rules [ 874.360912] env[67003]: INFO networking_nsxv3.common.synchronization [req-dfbb83aa-d3f3-4960-87fe-08c33ef40dad req-46fe12b6-8763-4c24-a135-340f3dd94ab8 service nova] Enqueued Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_members [ 874.360912] env[67003]: INFO networking_nsxv3.common.synchronization [req-dfbb83aa-d3f3-4960-87fe-08c33ef40dad req-46fe12b6-8763-4c24-a135-340f3dd94ab8 service nova] Enqueued Resource ID: c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8 with Priority: HIGHEST for action port [ 874.361518] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_rules [ 874.361627] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_members [ 874.361728] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8 with Priority: HIGHEST for action port [ 874.362065] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.362171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.362249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.363027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.363027] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.363687] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.363813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.364068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.364242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.364434] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.364540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.364616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.364782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.364869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.364979] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.366622] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.366702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.366738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.366917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.366997] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.850853] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: SUCCESS [ 874.851095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.868812] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.870598] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.870598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.871190] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8 with status ACTIVE [ 874.871369] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.871545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.871684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.872091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.872091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.872340] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.872475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.872625] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.872771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.872878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.873244] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.873636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.873636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.873712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.873744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.873872] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8 is going to be updated. [ 874.898806] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.898970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.899036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.899244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.899454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.899685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c99497b7-ea3a-40f9-9ce4-b25cb7ced6e8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.205617] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ed018b-2f29-4f20-913e-d07a9663638e in Status: SUCCESS [ 875.205831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.206012] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.206259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.206456] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.206662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.206662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.207642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.207642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.207642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.207642] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('11ed018b-2f29-4f20-913e-d07a9663638e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.372109] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.399907] env[67003]: INFO networking_nsxv3.common.synchronization [req-65123dd1-4084-4a39-9170-6a558b1559ac req-59e6579f-d348-415a-8d4b-2e64fabd9bc3 tempest-ServerRescueNegativeTestJSON-408866913 tempest-ServerRescueNegativeTestJSON-408866913-project-member] Enqueued Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_members [ 875.400444] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_members [ 875.400761] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.400863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.495886] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3cc0841b-286c-4904-bf0d-135e41f2566e in Status: SUCCESS [ 875.495886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.709840] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('11ed018b-2f29-4f20-913e-d07a9663638e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.849381] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-639 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.849990] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-639" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.851834] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-639" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.851834] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-639" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.851834] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.851834] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.851834] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.851834] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.851834] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.852250] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.852250] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 875.852250] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 875.852250] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 875.852375] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 875.852473] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 875.853035] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 875.873133] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 875.873133] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 875.873405] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 875.873607] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-639" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.873975] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-3cf0868f-7839-4d9b-9dfc-837dfe899523 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.874173] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-3cf0868f-7839-4d9b-9dfc-837dfe899523" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.874297] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-3cf0868f-7839-4d9b-9dfc-837dfe899523" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.874748] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-3cf0868f-7839-4d9b-9dfc-837dfe899523" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.874825] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cf0868f-7839-4d9b-9dfc-837dfe899523',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.876125] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.876323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.876440] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.876658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.876744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.876818] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 is going to be created. [ 875.904839] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.905618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.905618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.905959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.906139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.921135] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: UNINITIALIZED for 2s [ 876.213507] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 11ed018b-2f29-4f20-913e-d07a9663638e: rpc.has_security_group_logging(os_id): False [ 876.232460] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.232669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.232766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.232922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.233033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.233512] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.233644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.233644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.233782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.233860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.233998] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11ed018b-2f29-4f20-913e-d07a9663638e is going to be created. [ 876.300848] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.301048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.301048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.301353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.301455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.315923] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11ed018b-2f29-4f20-913e-d07a9663638e in Status: IN_PROGRESS for 2s [ 876.379946] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.380365] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.380365] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.380696] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.380860] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.381033] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 3cf0868f-7839-4d9b-9dfc-837dfe899523 not found, creating... [ 876.381342] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.381543] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.381711] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.382025] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.382190] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.382504] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.382708] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.382862] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.383110] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.383428] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.383655] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 3cf0868f-7839-4d9b-9dfc-837dfe899523 is going to be created. [ 876.424104] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.424509] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.424729] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.425236] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.425585] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.425964] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-3cf0868f-7839-4d9b-9dfc-837dfe899523" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.455581] env[67003]: INFO networking_nsxv3.common.synchronization [None req-166c747c-0bf8-4977-a5b5-51e623005502 None None] Enqueued Resource ID: db0375b8-b6e3-4b04-88cc-a213229258cd with Priority: HIGHEST for action port [ 876.462503] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db0375b8-b6e3-4b04-88cc-a213229258cd with Priority: HIGHEST for action port [ 876.462686] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-db0375b8-b6e3-4b04-88cc-a213229258cd taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.463466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db0375b8-b6e3-4b04-88cc-a213229258cd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.463466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db0375b8-b6e3-4b04-88cc-a213229258cd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.463466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db0375b8-b6e3-4b04-88cc-a213229258cd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.463466] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db0375b8-b6e3-4b04-88cc-a213229258cd',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.965427] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db0375b8-b6e3-4b04-88cc-a213229258cd [ 876.965989] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.965989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.965989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.967009] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.967009] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.967297] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db0375b8-b6e3-4b04-88cc-a213229258cd already deleted. [ 876.967297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db0375b8-b6e3-4b04-88cc-a213229258cd" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.615091] env[67003]: INFO networking_nsxv3.common.synchronization [req-65123dd1-4084-4a39-9170-6a558b1559ac req-19472d67-4d1c-4428-8408-34c86bd83378 service nova] Enqueued Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_rules [ 877.615564] env[67003]: INFO networking_nsxv3.common.synchronization [req-65123dd1-4084-4a39-9170-6a558b1559ac req-19472d67-4d1c-4428-8408-34c86bd83378 service nova] Enqueued Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_members [ 877.615564] env[67003]: INFO networking_nsxv3.common.synchronization [req-65123dd1-4084-4a39-9170-6a558b1559ac req-19472d67-4d1c-4428-8408-34c86bd83378 service nova] Enqueued Resource ID: 3cf0868f-7839-4d9b-9dfc-837dfe899523 with Priority: HIGHEST for action port [ 877.615940] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_rules [ 877.616114] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_members [ 877.616187] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cf0868f-7839-4d9b-9dfc-837dfe899523 with Priority: HIGHEST for action port [ 877.616496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.616598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.616798] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.616885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.617076] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-3cf0868f-7839-4d9b-9dfc-837dfe899523 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.617178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3cf0868f-7839-4d9b-9dfc-837dfe899523" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.617236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3cf0868f-7839-4d9b-9dfc-837dfe899523" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.617433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3cf0868f-7839-4d9b-9dfc-837dfe899523" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.617512] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3cf0868f-7839-4d9b-9dfc-837dfe899523',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.932364] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: SUCCESS [ 877.932364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.932364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.932364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.932364] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.932364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.932364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.932364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.932364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.932364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.932364] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.933246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.933542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.933659] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.933749] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.933749] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.933901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.933967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.934063] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.083442] env[67003]: INFO networking_nsxv3.common.synchronization [req-09ed9be0-c5ee-4683-b848-d025fd6c69be req-36fbd781-9e90-41eb-8fe7-d83cb7bb02a4 tempest-MigrationsAdminTest-779889772 tempest-MigrationsAdminTest-779889772-project-member] Enqueued Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_members [ 878.083994] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_members [ 878.084519] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.084644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.084757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.084901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.085573] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.085882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.085882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.086450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.086542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.086640] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.121046] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3cf0868f-7839-4d9b-9dfc-837dfe899523 with status ACTIVE [ 878.121046] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.121046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.121046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.121313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.121313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.121484] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.121592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.121654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.121806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.121881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.122084] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.122180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.122239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.122381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.122456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.122542] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3cf0868f-7839-4d9b-9dfc-837dfe899523 is going to be updated. [ 878.146960] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.147138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.147203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.147405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.147545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.148211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3cf0868f-7839-4d9b-9dfc-837dfe899523" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.330991] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 11ed018b-2f29-4f20-913e-d07a9663638e in Status: SUCCESS [ 878.331247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.435776] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.435915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.438320] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.494417] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-557 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.494638] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.495409] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.496063] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.496721] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.496924] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.497062] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.497311] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.497545] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.497763] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.497868] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.498045] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.498183] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.498302] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.498406] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.498536] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.519964] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.520266] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 878.520412] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.520586] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-557" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.520894] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-0650ed11-2e85-43b9-a429-a9054d005f4d taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.521154] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-0650ed11-2e85-43b9-a429-a9054d005f4d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.521226] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-0650ed11-2e85-43b9-a429-a9054d005f4d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.521496] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-0650ed11-2e85-43b9-a429-a9054d005f4d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.521641] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0650ed11-2e85-43b9-a429-a9054d005f4d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.588717] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.941810] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.024018] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.026839] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.026839] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.026839] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.026839] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.026839] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 0650ed11-2e85-43b9-a429-a9054d005f4d not found, creating... [ 879.026839] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.026839] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.026839] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.026839] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.027653] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.028569] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.028972] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.029794] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.029794] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.030090] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.030421] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 0650ed11-2e85-43b9-a429-a9054d005f4d is going to be created. [ 879.052834] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.052834] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.052834] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.055198] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.055198] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.055198] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-0650ed11-2e85-43b9-a429-a9054d005f4d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.091405] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.217859] env[67003]: INFO networking_nsxv3.common.synchronization [None req-2dddc321-d987-4e18-a5b7-ad6694d4b952 None None] Enqueued Resource ID: 8bc71f8c-5baa-477c-9375-afe534ce31ce with Priority: HIGHEST for action port [ 879.218405] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8bc71f8c-5baa-477c-9375-afe534ce31ce with Priority: HIGHEST for action port [ 879.218774] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-8bc71f8c-5baa-477c-9375-afe534ce31ce taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.218899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8bc71f8c-5baa-477c-9375-afe534ce31ce" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.218992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8bc71f8c-5baa-477c-9375-afe534ce31ce" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.223694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8bc71f8c-5baa-477c-9375-afe534ce31ce" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.223694] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8bc71f8c-5baa-477c-9375-afe534ce31ce',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.445603] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.445791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.445864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.446072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.446165] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.446265] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 is going to be updated. [ 879.480177] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.480362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.480406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.480607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.481046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.492887] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: IN_PROGRESS for 2s [ 879.596045] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.596045] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.596045] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.596045] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.596045] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.596330] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b is going to be updated. [ 879.631585] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.631742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.631801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.632043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.632172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.641827] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: IN_PROGRESS for 2s [ 879.726941] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8bc71f8c-5baa-477c-9375-afe534ce31ce [ 879.727197] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.727376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.728148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.728148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.728148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.728148] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8bc71f8c-5baa-477c-9375-afe534ce31ce already deleted. [ 879.728148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8bc71f8c-5baa-477c-9375-afe534ce31ce" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.851496] env[67003]: INFO networking_nsxv3.common.synchronization [req-09ed9be0-c5ee-4683-b848-d025fd6c69be req-c90363a7-8a99-472b-ac51-44687243401f service nova] Enqueued Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_rules [ 879.851696] env[67003]: INFO networking_nsxv3.common.synchronization [req-09ed9be0-c5ee-4683-b848-d025fd6c69be req-c90363a7-8a99-472b-ac51-44687243401f service nova] Enqueued Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_members [ 879.851837] env[67003]: INFO networking_nsxv3.common.synchronization [req-09ed9be0-c5ee-4683-b848-d025fd6c69be req-c90363a7-8a99-472b-ac51-44687243401f service nova] Enqueued Resource ID: 0650ed11-2e85-43b9-a429-a9054d005f4d with Priority: HIGHEST for action port [ 879.852501] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_rules [ 879.852662] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_members [ 879.852765] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0650ed11-2e85-43b9-a429-a9054d005f4d with Priority: HIGHEST for action port [ 879.853140] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.853306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.853375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.853596] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.853710] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.858272] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.858416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.858721] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0650ed11-2e85-43b9-a429-a9054d005f4d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.858838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0650ed11-2e85-43b9-a429-a9054d005f4d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.858838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0650ed11-2e85-43b9-a429-a9054d005f4d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.859044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0650ed11-2e85-43b9-a429-a9054d005f4d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.859146] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0650ed11-2e85-43b9-a429-a9054d005f4d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.370205] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.370205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.370205] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0650ed11-2e85-43b9-a429-a9054d005f4d with status ACTIVE [ 880.370205] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.370205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.370205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.370205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.370205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.370205] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.370205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.370205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.370205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.370205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.370205] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.372014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.372014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.372014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.372014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.372014] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0650ed11-2e85-43b9-a429-a9054d005f4d is going to be updated. [ 880.398860] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.402018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.402018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.402018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.402018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.402018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0650ed11-2e85-43b9-a429-a9054d005f4d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.702576] env[67003]: INFO networking_nsxv3.common.synchronization [req-ba750950-321e-4063-8ddd-54e9200115b9 req-8e0674fc-c5cc-4abb-9f86-b271cf9caa1f tempest-AttachVolumeShelveTestJSON-97641738 tempest-AttachVolumeShelveTestJSON-97641738-project-member] Enqueued Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_members [ 880.703181] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_members [ 880.703525] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-745fb2b7-cb25-4398-b51d-8a61982bb1ed taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.703646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.703711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.704151] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.704151] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.704311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.704311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.704445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.704534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.704604] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.104621] env[67003]: INFO networking_nsxv3.common.synchronization [req-2b4c04ae-1ed5-46e3-a230-9aff39a93b40 req-2b5014b8-6cca-4006-bb92-ef66726239fd tempest-ListImageFiltersTestJSON-522016889 tempest-ListImageFiltersTestJSON-522016889-project-member] Enqueued Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_members [ 881.105191] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGHEST for action security_group_members [ 881.105530] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.105654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.105722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.105934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.106094] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.106214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.106278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.106444] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.106528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.106617] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.141223] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.141667] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.141667] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.141761] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.143039] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.143039] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.143039] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.143039] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.143039] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.143039] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.143039] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 881.143039] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 881.144033] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 881.144099] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 881.144188] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 881.144318] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 881.167465] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 881.167644] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 881.167785] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 881.167961] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.168336] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-0acc8972-7afe-418e-96b9-4c8ddddd8d53 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.168480] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.168601] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.168929] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.169079] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0acc8972-7afe-418e-96b9-4c8ddddd8d53',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.207908] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.208077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.208152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.208356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.208445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.208640] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.208737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.208801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.208943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.209028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.209117] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed already deleted. [ 881.209194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.504338] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: SUCCESS [ 881.504683] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.504734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.504969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.505188] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.505366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.505442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.505611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.505695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.505794] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.611542] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.611542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.611542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.611542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.636839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.636839] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.636839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.636839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.636839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.636839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.636839] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a is going to be updated. [ 881.657741] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: SUCCESS [ 881.657741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.657741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.657741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.657741] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.657741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.657741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.657741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.657741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.657741] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.667455] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.667615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.667671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.668014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.668090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.671765] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.671963] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.672101] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.672361] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.672548] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.672701] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 0acc8972-7afe-418e-96b9-4c8ddddd8d53 not found, creating... [ 881.672952] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.673129] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.673238] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.673466] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.673601] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.673871] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.674030] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.674146] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.674349] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.674482] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.674616] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 0acc8972-7afe-418e-96b9-4c8ddddd8d53 is going to be created. [ 881.679515] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: IN_PROGRESS for 2s [ 881.701603] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.703606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.703606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.703606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.703606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.703606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.007894] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.160487] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.456894] env[67003]: INFO networking_nsxv3.common.synchronization [req-ba750950-321e-4063-8ddd-54e9200115b9 req-0eb16e62-2915-4d81-9a0d-c1b7c393f797 service nova] Enqueued Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_rules [ 882.457097] env[67003]: INFO networking_nsxv3.common.synchronization [req-ba750950-321e-4063-8ddd-54e9200115b9 req-0eb16e62-2915-4d81-9a0d-c1b7c393f797 service nova] Enqueued Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_members [ 882.457242] env[67003]: INFO networking_nsxv3.common.synchronization [req-ba750950-321e-4063-8ddd-54e9200115b9 req-0eb16e62-2915-4d81-9a0d-c1b7c393f797 service nova] Enqueued Resource ID: 0acc8972-7afe-418e-96b9-4c8ddddd8d53 with Priority: HIGHEST for action port [ 882.457891] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_rules [ 882.457944] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_members [ 882.463213] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0acc8972-7afe-418e-96b9-4c8ddddd8d53 with Priority: HIGHEST for action port [ 882.463697] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.463868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.463933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.464135] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.464237] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.466955] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-745fb2b7-cb25-4398-b51d-8a61982bb1ed taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.467087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.467149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.467620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.467795] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.467893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.467958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.468303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.468303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.468303] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.470847] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0acc8972-7afe-418e-96b9-4c8ddddd8d53 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.470982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.471096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.471293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.471375] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0acc8972-7afe-418e-96b9-4c8ddddd8d53',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.513981] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.662731] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.967955] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-745fb2b7-cb25-4398-b51d-8a61982bb1ed taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.968135] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.974086] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0acc8972-7afe-418e-96b9-4c8ddddd8d53 with status ACTIVE [ 882.975024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.975024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.975024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.975024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.975024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.975024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.978920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.978920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.978920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.978920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.978920] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.978920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.978920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.978920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.978920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.978920] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0acc8972-7afe-418e-96b9-4c8ddddd8d53 is going to be updated. [ 882.981590] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.014375] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.014481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.014542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.014745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.014878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.015113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.015547] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.015715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.015715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.016070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.016070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.016070] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 is going to be updated. [ 883.048743] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.049227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.049344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.049664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.049832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.072710] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: IN_PROGRESS for 2s [ 883.169745] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.169894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.169969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.170212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.170301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.170398] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b is going to be updated. [ 883.214644] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.214870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.214870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.215153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.215445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.226144] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: IN_PROGRESS for 2s [ 883.273658] env[67003]: INFO networking_nsxv3.common.synchronization [req-3ca1b2c2-bd56-49b2-b453-3e6958ea5b58 req-7d664ff9-7207-4841-a56b-2bb5b3dde8d5 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 883.274237] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 883.274541] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.274666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.274734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.275432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.275432] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.275432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.275605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.275715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.275820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.275937] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.484685] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.645888] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.646230] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-851" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.646230] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-851" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.646548] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-851" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.646810] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.647561] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.647561] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.647561] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.647561] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.647712] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.647801] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 883.647941] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 883.648819] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 883.648819] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 883.648819] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 883.648819] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 883.673883] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 883.674060] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 883.674199] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 883.674376] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-851" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.674694] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-633439b6-aa04-4f3c-9e40-af9515e544fa taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.674868] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.674991] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.675350] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.675494] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('633439b6-aa04-4f3c-9e40-af9515e544fa',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.691753] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: IN_PROGRESS for 4s [ 883.780038] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.780038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.780038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.780038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.780038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.780038] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.780038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.780038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.780038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.780470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.780470] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 already deleted. [ 883.780470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.987102] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.987299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.987299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.987506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.987645] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.987785] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed is going to be created. [ 884.014616] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.014771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.014855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.015116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.015402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.026450] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed in Status: UNINITIALIZED for 2s [ 884.177991] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.178249] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.178307] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.178747] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.178959] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.179173] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 633439b6-aa04-4f3c-9e40-af9515e544fa not found, creating... [ 884.179488] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.179687] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.179807] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.180411] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.180411] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.180672] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.181456] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.181666] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.181936] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.182744] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.182744] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 633439b6-aa04-4f3c-9e40-af9515e544fa is going to be created. [ 884.205298] env[67003]: INFO networking_nsxv3.common.synchronization [req-dd338841-e4b9-4eb4-8040-2c511bb02481 req-fa84dcc7-7c1e-4d78-8143-41073407c7d5 tempest-ServersAdminNegativeTestJSON-1891119767 tempest-ServersAdminNegativeTestJSON-1891119767-project-member] Enqueued Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_members [ 884.206576] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.206796] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.206977] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.207316] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.207608] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.207875] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.209024] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_members [ 884.209473] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.209626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.209718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.209930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.210127] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.210260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.210360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.210534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.210639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.210754] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.714412] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.975536] env[67003]: INFO networking_nsxv3.common.synchronization [req-3ca1b2c2-bd56-49b2-b453-3e6958ea5b58 req-ef8279d8-d98c-44fd-9233-b464179ddc8a service nova] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_rules [ 884.975536] env[67003]: INFO networking_nsxv3.common.synchronization [req-3ca1b2c2-bd56-49b2-b453-3e6958ea5b58 req-ef8279d8-d98c-44fd-9233-b464179ddc8a service nova] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 884.975536] env[67003]: INFO networking_nsxv3.common.synchronization [req-3ca1b2c2-bd56-49b2-b453-3e6958ea5b58 req-ef8279d8-d98c-44fd-9233-b464179ddc8a service nova] Enqueued Resource ID: 633439b6-aa04-4f3c-9e40-af9515e544fa with Priority: HIGHEST for action port [ 884.975536] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_rules [ 884.975536] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 884.975536] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 633439b6-aa04-4f3c-9e40-af9515e544fa with Priority: HIGHEST for action port [ 884.975859] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.975962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.976025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.976310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.976433] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.978466] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.978616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.978700] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.979037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.979355] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.979585] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.979726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.980022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.980251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.980405] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.981572] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-633439b6-aa04-4f3c-9e40-af9515e544fa taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.981729] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.981820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.982021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.982140] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('633439b6-aa04-4f3c-9e40-af9515e544fa',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.084691] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: SUCCESS [ 885.084691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.084691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.084691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.084691] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.084691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.084691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.084691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.084691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.084691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.084691] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.084691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.084691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.085642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.085642] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.085642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.085642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.085814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.085942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.086111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.086406] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.220044] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.237330] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: SUCCESS [ 885.237694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.237884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.238420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.238420] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.238562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.238562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.238698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.238795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.238884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.238976] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.484848] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.485035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.485398] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.486335] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 633439b6-aa04-4f3c-9e40-af9515e544fa with status ACTIVE [ 885.486616] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.486734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.486825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.487254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.487254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.487352] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.487478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.487554] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.489510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.489510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.489510] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.489510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.489510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.489510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.489510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.489510] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 633439b6-aa04-4f3c-9e40-af9515e544fa is going to be updated. [ 885.515923] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.516048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.516136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.516450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.516663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.517353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.591809] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88eb58df-f15b-48e8-baa4-7b64e596d069: rpc.has_security_group_logging(os_id): False [ 885.620309] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.620528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.620587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.620786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.620849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.621072] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.621183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.621235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.621558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.621638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.621907] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.622027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.622279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.622519] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.622666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.622991] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.623217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.623332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.623533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.623657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.623802] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 is going to be created. [ 885.705820] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a in Status: SUCCESS [ 885.707745] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a deletion is rescheduled due to dependency. [ 885.707745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.722486] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.722918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.723403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.723723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.723864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.724020] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc is going to be updated. [ 885.741791] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.741791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.741791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.742028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.742232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.744121] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.744251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.744322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.744511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.744670] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.744770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.744834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.745040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.745160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.745471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.745471] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.745629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.745629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.745722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.745891] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.745957] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.746061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.746213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.746291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.746375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.746463] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.758720] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: IN_PROGRESS for 2s [ 885.794436] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.794989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.795740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.795740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.795836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.809768] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: IN_PROGRESS for 2s [ 885.992560] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.037129] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed in Status: SUCCESS [ 886.037599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.037599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.037743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.037965] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.038043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.038131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.038334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.038458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.038458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.038514] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.114151] env[67003]: INFO networking_nsxv3.common.synchronization [req-0c6c7987-14da-45fb-96d0-fbfae85523c6 req-26745984-49b8-44ad-8d9f-4b8d6e9c1f83 tempest-ServerDiskConfigTestJSON-448903628 tempest-ServerDiskConfigTestJSON-448903628-project-member] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 886.114766] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 886.115077] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.115228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.115327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.115550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.115691] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.115789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.115854] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.115995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.116093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.116187] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.249702] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d622b8c0-157c-4b92-b9e3-c2d6c4c2793b: rpc.has_security_group_logging(os_id): False [ 886.268611] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.268750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.268821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.269042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.269135] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.269351] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.269452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.269506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.269653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.269728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.269900] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.269991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.270061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.270197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.270272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.270447] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.270541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.270604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.270731] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.270804] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.270888] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b is going to be updated. [ 886.338767] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.338976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.338976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.339209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.339358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.357204] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: IN_PROGRESS for 2s [ 886.458302] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.458516] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.458628] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.459538] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.460295] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.460295] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.460295] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.460523] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.460680] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.460894] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.461015] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 886.461121] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 886.461229] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 886.461337] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 886.461440] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 886.461581] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 886.494476] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.494640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.494695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.494925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.495021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.495121] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be created. [ 886.542831] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.607939] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 886.607939] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.145 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 886.607939] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 886.607939] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.607939] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.607939] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.607939] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.607939] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.607939] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.622024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.622024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.622024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.622024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.622024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.622024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.622024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.622024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.622024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.622024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.622024] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 886.637124] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.637237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.637237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.637470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.637640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.665050] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: UNINITIALIZED for 2s [ 886.695190] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.695410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.695453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.695660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.695808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.712187] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 887.046961] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 745fb2b7-cb25-4398-b51d-8a61982bb1ed: rpc.has_security_group_logging(os_id): False [ 887.065928] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.065928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.065928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.065928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.065928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.066168] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.066262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.066306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.066450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.066528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.066635] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed is going to be created. [ 887.111908] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.112401] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.112401] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.112659] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.112812] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.112969] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c not found, creating... [ 887.113342] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.113654] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.113720] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.113985] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.114159] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.114442] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.114596] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.115494] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.115494] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.115494] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.115494] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c is going to be created. [ 887.135494] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.135494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.135494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.135671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.135828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.149299] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.149574] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.149675] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.149933] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.150155] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.150380] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.153773] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed in Status: IN_PROGRESS for 2s [ 887.730077] env[67003]: INFO networking_nsxv3.common.synchronization [req-0c6c7987-14da-45fb-96d0-fbfae85523c6 req-b3a2aa63-620e-4a86-b409-73d8416ac51a service nova] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_rules [ 887.730303] env[67003]: INFO networking_nsxv3.common.synchronization [req-0c6c7987-14da-45fb-96d0-fbfae85523c6 req-b3a2aa63-620e-4a86-b409-73d8416ac51a service nova] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 887.730447] env[67003]: INFO networking_nsxv3.common.synchronization [req-0c6c7987-14da-45fb-96d0-fbfae85523c6 req-b3a2aa63-620e-4a86-b409-73d8416ac51a service nova] Enqueued Resource ID: 2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c with Priority: HIGHEST for action port [ 887.731585] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_rules [ 887.731767] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 887.731871] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c with Priority: HIGHEST for action port [ 887.732185] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.732325] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.732405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.732606] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.732688] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.735823] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.735923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.736276] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.736482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.736567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.736895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.736971] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.791909] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: SUCCESS [ 887.792122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.792454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.792488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.793201] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.821973] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: SUCCESS [ 887.822152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.240941] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.241308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.241308] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c with status ACTIVE [ 888.241485] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.241724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.241724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.241912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.242037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.242238] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.242347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.242429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.242609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.242690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.245581] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.245581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.245581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.245581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.245581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.245581] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c is going to be updated. [ 888.268204] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.268204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.268204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.268397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.268563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.268749] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2601a8e6-d36a-4ee6-8e6f-6fe2afe5f13c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.296037] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.296278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.296404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.296839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.297115] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.297204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.297311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.297548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.297640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.297730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.297844] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.378176] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: SUCCESS [ 888.379665] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.676825] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 888.677066] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.677462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.677658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.677819] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.677938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.678310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.678310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.678310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.678451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.678451] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.727071] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 888.727071] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 deletion is rescheduled due to dependency. [ 888.727071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.727071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.727071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.727071] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.727071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.727071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.727071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.727071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.727071] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.801169] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.801398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.801519] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.801832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.802057] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.802217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.802322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.802525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.802624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.802726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.802891] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.803059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.803150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.803364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.803518] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.803629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.803690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.803882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.804017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.804138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.804234] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.166671] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed in Status: SUCCESS [ 889.166671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.183161] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.183330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.183406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.183633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.183797] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.183899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.183963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.184126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.184211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.184300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.184448] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.184540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.184607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.184749] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.184886] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.184977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.185049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.185185] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.185265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.185363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.185454] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.230405] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.308181] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88eb58df-f15b-48e8-baa4-7b64e596d069: rpc.has_security_group_logging(os_id): False [ 889.326272] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.326420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.327033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.327033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.327033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.327033] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.327242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.327242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.327308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.327405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.327533] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.327738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.327811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.327958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.328046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.328350] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.328350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.328450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.328531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.328603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.328688] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 is going to be updated. [ 889.390373] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.390666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.390822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.391114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.392355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.405058] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: IN_PROGRESS for 2s [ 889.689663] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc04636e-53f4-4929-8ae4-d13a910a1d84: rpc.has_security_group_logging(os_id): False [ 889.710382] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.710382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.710382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.710561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.711314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.711314] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.711314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.711314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.711314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.711314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.711787] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.711787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.711787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.711927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.712031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.713943] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.713943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.713943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.713943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.713943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.713943] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be created. [ 889.732077] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 889.787444] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.787650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.787705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.787960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.788205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.802504] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 890.234757] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.234757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.235040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.235119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.235219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.235367] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 890.274505] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.274696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.274696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.275070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.275254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.289749] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 891.425050] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: SUCCESS [ 891.425391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.635901] env[67003]: INFO networking_nsxv3.common.synchronization [req-36743799-3d83-48e9-99f2-3221b3ea590c req-d9a41377-abe5-476d-b4aa-176143e06d77 tempest-ListServersNegativeTestJSON-1594397262 tempest-ListServersNegativeTestJSON-1594397262-project-member] Enqueued Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 891.636510] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 891.636862] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.636985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.638224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.638418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.638580] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.638716] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.638796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.638980] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.639104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.639221] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.759919] env[67003]: INFO networking_nsxv3.common.synchronization [req-deb3f68f-0805-4a35-8b3b-a8fad680efc8 req-f3ae47d8-612c-41e7-9ffc-e2e608851239 tempest-ListServersNegativeTestJSON-1594397262 tempest-ListServersNegativeTestJSON-1594397262-project-member] Enqueued Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 891.760450] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 with Priority: HIGHEST for action security_group_members [ 891.760917] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.761235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.818352] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 891.818352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.080580] env[67003]: INFO networking_nsxv3.common.synchronization [req-01b32d7c-8eef-49ca-8528-cb85c9b0b637 req-dc295d9e-0d26-4b4e-8afa-11a662cc47ce tempest-ServersAdminTestJSON-1432619756 tempest-ServersAdminTestJSON-1432619756-project-member] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 892.081297] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 892.081664] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.081827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.081944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.082159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.082796] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.082796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.082796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.082796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.083035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.083035] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.141894] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.301168] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 892.301436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.301615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.301826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.302054] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.303498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.303498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.303498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.303498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.303498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.303498] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.587443] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.644439] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.805780] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.805780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.805780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.805986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.806171] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.806355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.806419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.806608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.806707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.806797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.806979] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.807100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.807149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.807320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.807469] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.807566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.807638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.807864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.807962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.808107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.808209] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.091198] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.148861] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.148861] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.148861] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.148861] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.148861] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.148861] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 is going to be updated. [ 893.183726] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.183835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.183927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.184397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.184541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.202548] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: IN_PROGRESS for 2s [ 893.311659] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25f0058d-8729-4623-a291-7d3376597063: rpc.has_security_group_logging(os_id): False [ 893.330886] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.331068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.331068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.331266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.331359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.331555] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.331655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.331720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.331865] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.332037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.332250] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.332347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.332411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.332552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.332627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.332902] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.332902] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.333048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.333106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.333179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.333273] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 893.402349] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.402556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.402658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.402934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.403106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.416321] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 893.594770] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.595097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.595097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.595238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.595394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.595528] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 893.630586] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.630586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.630586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.630586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.630586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.640429] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 894.422180] env[67003]: INFO networking_nsxv3.common.synchronization [req-a54633b7-eb94-4e1a-a22c-9675dd626084 req-649ef1cd-2521-49c1-992a-0b83ae58483f tempest-ListServerFiltersTestJSON-449543784 tempest-ListServerFiltersTestJSON-449543784-project-member] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 894.422762] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 894.423553] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.423754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.423806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.424056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.424236] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.424347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.424406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.424579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.424664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.424766] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.842236] env[67003]: INFO networking_nsxv3.common.synchronization [req-6b448ade-84e1-4058-a5e3-baca3c8291ce req-fc84a5db-424f-4139-afa0-c4d44dc17f1a tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGHEST for action security_group_members [ 894.842907] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGHEST for action security_group_members [ 894.843328] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2e25f5a-d04c-463f-a7f6-17866b02d583 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.843456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.843526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.843829] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.844011] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.844122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.844189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.844348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.844433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.844527] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2e25f5a-d04c-463f-a7f6-17866b02d583',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.864993] env[67003]: INFO networking_nsxv3.common.synchronization [req-3f6fedef-a1ac-4dc7-b79f-d22762ea1b23 req-627b1ff7-dccb-4fbc-9c6d-079f0cd24b8e tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 894.865194] env[67003]: INFO networking_nsxv3.common.synchronization [req-3f6fedef-a1ac-4dc7-b79f-d22762ea1b23 req-627b1ff7-dccb-4fbc-9c6d-079f0cd24b8e tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_members [ 894.865859] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 894.866655] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_members [ 894.866655] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.866655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.866655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.866994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.866994] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.867087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.867153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.867363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.867450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.867546] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.868517] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea11303f-c0fb-4922-8c26-9eb29fdbf672 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.868627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.868694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.868902] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.869061] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.869158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.869221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.869459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.869860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.869860] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.914623] env[67003]: INFO networking_nsxv3.common.synchronization [req-3f6fedef-a1ac-4dc7-b79f-d22762ea1b23 req-627b1ff7-dccb-4fbc-9c6d-079f0cd24b8e tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_rules [ 894.914796] env[67003]: INFO networking_nsxv3.common.synchronization [req-3f6fedef-a1ac-4dc7-b79f-d22762ea1b23 req-627b1ff7-dccb-4fbc-9c6d-079f0cd24b8e tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 894.914934] env[67003]: INFO networking_nsxv3.common.synchronization [req-3f6fedef-a1ac-4dc7-b79f-d22762ea1b23 req-627b1ff7-dccb-4fbc-9c6d-079f0cd24b8e tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_rules [ 894.915074] env[67003]: INFO networking_nsxv3.common.synchronization [req-3f6fedef-a1ac-4dc7-b79f-d22762ea1b23 req-627b1ff7-dccb-4fbc-9c6d-079f0cd24b8e tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_members [ 894.915206] env[67003]: INFO networking_nsxv3.common.synchronization [req-3f6fedef-a1ac-4dc7-b79f-d22762ea1b23 req-627b1ff7-dccb-4fbc-9c6d-079f0cd24b8e tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: 633439b6-aa04-4f3c-9e40-af9515e544fa with Priority: HIGHEST for action port [ 894.915751] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_rules [ 894.915883] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_rules [ 894.915984] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 633439b6-aa04-4f3c-9e40-af9515e544fa with Priority: HIGHEST for action port [ 894.916273] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 894.916391] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_members [ 894.916830] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.916970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.917039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.917244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.917382] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.918302] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.918421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.918489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.918806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.918890] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.923496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-633439b6-aa04-4f3c-9e40-af9515e544fa taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.923496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.923496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.923496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.923496] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('633439b6-aa04-4f3c-9e40-af9515e544fa',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.923496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.923496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.923496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea11303f-c0fb-4922-8c26-9eb29fdbf672 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.923496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.929025] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.214131] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: SUCCESS [ 895.214521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.215525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.215799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.216046] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.216176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.216267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.216494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.219152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.219334] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eda6bee5-9b5c-4b6f-888f-231f9c7282b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.228428] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.228428] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.228428] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.228428] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.228428] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.228428] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.228428] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.228428] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.228697] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.228798] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.228992] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.229856] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.229856] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.229856] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.229856] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.229856] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.249475] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.249475] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.249587] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.249749] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.250081] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-686f7cc8-f274-493a-b958-eacfbf715b4f taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.250268] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-686f7cc8-f274-493a-b958-eacfbf715b4f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.250393] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-686f7cc8-f274-493a-b958-eacfbf715b4f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.250742] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-686f7cc8-f274-493a-b958-eacfbf715b4f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.250878] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('686f7cc8-f274-493a-b958-eacfbf715b4f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.347271] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.347428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.347491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.347715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.348775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.348775] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.348775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.348775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.348775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.348775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.348775] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 already deleted. [ 895.348775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.371682] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.373728] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.422764] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 633439b6-aa04-4f3c-9e40-af9515e544fa with status ACTIVE [ 895.422996] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.423158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.423257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.423454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.424310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.424310] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.424310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.424310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.424310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.424310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.424310] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.424662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.424662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.424662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.424662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.424761] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 633439b6-aa04-4f3c-9e40-af9515e544fa is going to be updated. [ 895.425830] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea11303f-c0fb-4922-8c26-9eb29fdbf672 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.425954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.426222] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.426317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.429328] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 895.429885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.430810] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.446240] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.446498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.446498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.446701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.446841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.447012] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.595517] env[67003]: INFO networking_nsxv3.common.synchronization [req-b9e27fd1-00cf-48d6-bfb5-e8aa7f5f5e05 req-2685098e-272e-4bc5-95f6-98c9bb329637 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: 879b3713-7487-492d-b6e1-77747451fce3 with Priority: HIGHEST for action security_group_members [ 895.595712] env[67003]: INFO networking_nsxv3.common.synchronization [req-b9e27fd1-00cf-48d6-bfb5-e8aa7f5f5e05 req-2685098e-272e-4bc5-95f6-98c9bb329637 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 895.595850] env[67003]: INFO networking_nsxv3.common.synchronization [req-b9e27fd1-00cf-48d6-bfb5-e8aa7f5f5e05 req-2685098e-272e-4bc5-95f6-98c9bb329637 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_members [ 895.596461] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 879b3713-7487-492d-b6e1-77747451fce3 with Priority: HIGHEST for action security_group_members [ 895.596614] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 895.597029] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_members [ 895.597029] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-879b3713-7487-492d-b6e1-77747451fce3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.597126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.597184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.597546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.597616] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.597757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.597838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.598009] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.598106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.598222] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('879b3713-7487-492d-b6e1-77747451fce3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.599152] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.599250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.599445] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea11303f-c0fb-4922-8c26-9eb29fdbf672 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.599544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.644349] env[67003]: INFO networking_nsxv3.common.synchronization [req-b9e27fd1-00cf-48d6-bfb5-e8aa7f5f5e05 req-2685098e-272e-4bc5-95f6-98c9bb329637 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: 879b3713-7487-492d-b6e1-77747451fce3 with Priority: HIGHEST for action security_group_rules [ 895.644529] env[67003]: INFO networking_nsxv3.common.synchronization [req-b9e27fd1-00cf-48d6-bfb5-e8aa7f5f5e05 req-2685098e-272e-4bc5-95f6-98c9bb329637 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: 879b3713-7487-492d-b6e1-77747451fce3 with Priority: HIGHEST for action security_group_members [ 895.644662] env[67003]: INFO networking_nsxv3.common.synchronization [req-b9e27fd1-00cf-48d6-bfb5-e8aa7f5f5e05 req-2685098e-272e-4bc5-95f6-98c9bb329637 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_rules [ 895.644826] env[67003]: INFO networking_nsxv3.common.synchronization [req-b9e27fd1-00cf-48d6-bfb5-e8aa7f5f5e05 req-2685098e-272e-4bc5-95f6-98c9bb329637 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 895.644912] env[67003]: INFO networking_nsxv3.common.synchronization [req-b9e27fd1-00cf-48d6-bfb5-e8aa7f5f5e05 req-2685098e-272e-4bc5-95f6-98c9bb329637 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_rules [ 895.645047] env[67003]: INFO networking_nsxv3.common.synchronization [req-b9e27fd1-00cf-48d6-bfb5-e8aa7f5f5e05 req-2685098e-272e-4bc5-95f6-98c9bb329637 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_members [ 895.645175] env[67003]: INFO networking_nsxv3.common.synchronization [req-b9e27fd1-00cf-48d6-bfb5-e8aa7f5f5e05 req-2685098e-272e-4bc5-95f6-98c9bb329637 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: 633439b6-aa04-4f3c-9e40-af9515e544fa with Priority: HIGHEST for action port [ 895.645828] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 879b3713-7487-492d-b6e1-77747451fce3 with Priority: HIGHEST for action security_group_rules [ 895.645971] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_rules [ 895.646093] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_members [ 895.646186] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 633439b6-aa04-4f3c-9e40-af9515e544fa with Priority: HIGHEST for action port [ 895.646272] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_rules [ 895.648188] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 879b3713-7487-492d-b6e1-77747451fce3 with Priority: HIGHEST for action security_group_members [ 895.648398] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 895.648801] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-879b3713-7487-492d-b6e1-77747451fce3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.648898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.648967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.649255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.649322] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('879b3713-7487-492d-b6e1-77747451fce3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.650338] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.650456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.650704] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea11303f-c0fb-4922-8c26-9eb29fdbf672 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.650790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.650971] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-633439b6-aa04-4f3c-9e40-af9515e544fa taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.651457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.651457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.651457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.651457] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('633439b6-aa04-4f3c-9e40-af9515e544fa',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.652457] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.652569] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.653047] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-879b3713-7487-492d-b6e1-77747451fce3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.653142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.653353] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.653438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.654368] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 895.654558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.721726] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.721882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.721948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.722184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.722276] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.722478] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.722578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.722639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.722782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.722857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.722941] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 is going to be updated. [ 895.753744] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.754049] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.754189] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.754596] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.754849] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.754999] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 686f7cc8-f274-493a-b958-eacfbf715b4f not found, creating... [ 895.755436] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.755601] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.755735] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.756017] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.756235] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.758225] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.758225] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.758225] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.758225] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.758225] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.758225] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 686f7cc8-f274-493a-b958-eacfbf715b4f is going to be created. [ 895.770205] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.770481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.770623] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.770987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.771359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.783071] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: IN_PROGRESS for 2s [ 895.786868] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.787206] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.787382] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.789535] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.789535] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.789535] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-686f7cc8-f274-493a-b958-eacfbf715b4f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.874970] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.876780] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.933482] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.933482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.933482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.933482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.933482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.933738] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 is going to be updated. [ 895.975630] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.975780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.975843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.976073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.976311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.986755] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: IN_PROGRESS for 2s [ 896.100968] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('879b3713-7487-492d-b6e1-77747451fce3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.155771] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 633439b6-aa04-4f3c-9e40-af9515e544fa with status ACTIVE [ 896.156028] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.156163] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.156232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.156561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.156654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.156856] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.156955] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.157026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.157175] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.157250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.157435] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.157521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.157779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.157779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.157779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.157896] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 633439b6-aa04-4f3c-9e40-af9515e544fa is going to be updated. [ 896.159535] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-879b3713-7487-492d-b6e1-77747451fce3 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.159655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.184818] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.185125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.185125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.185281] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.185769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.186014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-633439b6-aa04-4f3c-9e40-af9515e544fa" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.377875] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.378029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.378116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.378348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.378451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.378575] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 896.381991] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.382239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.382349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.382580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.384715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.384715] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 is going to be created. [ 896.410821] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.411030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.411182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.411438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.411670] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.415646] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.415718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.415917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.416188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.416331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.426177] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 896.426871] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: UNINITIALIZED for 2s [ 896.512610] env[67003]: INFO networking_nsxv3.common.synchronization [req-6b448ade-84e1-4058-a5e3-baca3c8291ce req-b5faa410-26c8-496a-9c74-30d69467fa8b service nova] Enqueued Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGHEST for action security_group_rules [ 896.512930] env[67003]: INFO networking_nsxv3.common.synchronization [req-6b448ade-84e1-4058-a5e3-baca3c8291ce req-b5faa410-26c8-496a-9c74-30d69467fa8b service nova] Enqueued Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGHEST for action security_group_members [ 896.513840] env[67003]: INFO networking_nsxv3.common.synchronization [req-6b448ade-84e1-4058-a5e3-baca3c8291ce req-b5faa410-26c8-496a-9c74-30d69467fa8b service nova] Enqueued Resource ID: 686f7cc8-f274-493a-b958-eacfbf715b4f with Priority: HIGHEST for action port [ 896.514912] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGHEST for action security_group_rules [ 896.515171] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGHEST for action security_group_members [ 896.515380] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 686f7cc8-f274-493a-b958-eacfbf715b4f with Priority: HIGHEST for action port [ 896.516212] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2e25f5a-d04c-463f-a7f6-17866b02d583 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.516859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.516859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.516859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.517784] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2e25f5a-d04c-463f-a7f6-17866b02d583',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.519491] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2e25f5a-d04c-463f-a7f6-17866b02d583 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.522026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.522537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.522537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.524157] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.524157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.524157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.524157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.524157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.524157] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2e25f5a-d04c-463f-a7f6-17866b02d583',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.526052] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-686f7cc8-f274-493a-b958-eacfbf715b4f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.526052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-686f7cc8-f274-493a-b958-eacfbf715b4f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.526052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-686f7cc8-f274-493a-b958-eacfbf715b4f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.529042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-686f7cc8-f274-493a-b958-eacfbf715b4f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.529042] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('686f7cc8-f274-493a-b958-eacfbf715b4f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.604464] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('879b3713-7487-492d-b6e1-77747451fce3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.028428] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f2e25f5a-d04c-463f-a7f6-17866b02d583',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.029571] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2e25f5a-d04c-463f-a7f6-17866b02d583 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.029691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.029868] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 686f7cc8-f274-493a-b958-eacfbf715b4f with status ACTIVE [ 897.030043] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.030152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.030218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.030419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.030508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.030677] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.030772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.030834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.030983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.031078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.031341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.031418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.031503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.031591] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.031680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.031789] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 686f7cc8-f274-493a-b958-eacfbf715b4f is going to be updated. [ 897.056979] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.056979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.056979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.056979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.056979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.057278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-686f7cc8-f274-493a-b958-eacfbf715b4f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.107617] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.107823] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.107921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.108240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.108354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.108562] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 879b3713-7487-492d-b6e1-77747451fce3 is going to be created. [ 897.140659] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.142106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.142106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.142106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.142413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.153964] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 879b3713-7487-492d-b6e1-77747451fce3 in Status: UNINITIALIZED for 2s [ 897.417588] env[67003]: INFO networking_nsxv3.common.synchronization [req-91d03a41-0ba2-4464-8c6d-aef95c8a0afe req-ff355b1a-35df-46f6-b19c-c8a7cce56680 tempest-DeleteServersTestJSON-1342989894 tempest-DeleteServersTestJSON-1342989894-project-member] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 897.421976] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 897.421976] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.421976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.421976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.421976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.421976] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.421976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.421976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.421976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.421976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.421976] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.534727] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f2e25f5a-d04c-463f-a7f6-17866b02d583',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.792684] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-521 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.792684] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.793059] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.793059] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.793382] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.794351] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.794351] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.794351] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.794351] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.795185] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.795185] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 897.795185] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 897.795185] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 897.795185] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 897.795185] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 897.795185] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 897.797107] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 in Status: SUCCESS [ 897.797354] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eda6bee5-9b5c-4b6f-888f-231f9c7282b1 deletion is rescheduled due to dependency. [ 897.797518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eda6bee5-9b5c-4b6f-888f-231f9c7282b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.818286] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 897.818659] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 897.818992] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 897.819322] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.819684] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-1c700070-2f87-44a9-8dfd-c57e5a935976 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.819866] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-1c700070-2f87-44a9-8dfd-c57e5a935976" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.819986] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-1c700070-2f87-44a9-8dfd-c57e5a935976" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.820340] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-1c700070-2f87-44a9-8dfd-c57e5a935976" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.820469] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c700070-2f87-44a9-8dfd-c57e5a935976',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.923161] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.923161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.923161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.923161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.923161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.923161] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.923594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.923594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.923594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.923737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.923737] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be deleted. [ 897.981669] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.981669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.981859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.981978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.982103] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.982206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.000436] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: SUCCESS [ 898.000436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.038050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.038050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.038050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.038050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.038681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.038681] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 is going to be created. [ 898.066134] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.066260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.066260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.066543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.066631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.081328] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 in Status: UNINITIALIZED for 2s [ 898.323478] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.323709] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.323837] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.324193] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.324350] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.324542] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 1c700070-2f87-44a9-8dfd-c57e5a935976 not found, creating... [ 898.324825] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.324993] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.325133] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.325370] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.325525] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.326061] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.326061] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.326147] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.326298] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.326454] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.326588] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 1c700070-2f87-44a9-8dfd-c57e5a935976 is going to be created. [ 898.353290] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.353541] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.353672] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.353989] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.354219] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.354396] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-1c700070-2f87-44a9-8dfd-c57e5a935976" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.442478] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: SUCCESS [ 898.442746] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.442930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.443213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.443450] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.443577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.443648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.443847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.443932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.444068] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.445633] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 898.445809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.445971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.446144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.446312] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.446441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.446510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.446655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.446731] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.446833] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.949743] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.950757] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.099278] env[67003]: INFO networking_nsxv3.common.synchronization [req-91d03a41-0ba2-4464-8c6d-aef95c8a0afe req-60d14869-d6a5-4a5c-9b48-db682334ab82 service nova] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_rules [ 899.099278] env[67003]: INFO networking_nsxv3.common.synchronization [req-91d03a41-0ba2-4464-8c6d-aef95c8a0afe req-60d14869-d6a5-4a5c-9b48-db682334ab82 service nova] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 899.099278] env[67003]: INFO networking_nsxv3.common.synchronization [req-91d03a41-0ba2-4464-8c6d-aef95c8a0afe req-60d14869-d6a5-4a5c-9b48-db682334ab82 service nova] Enqueued Resource ID: 1c700070-2f87-44a9-8dfd-c57e5a935976 with Priority: HIGHEST for action port [ 899.099278] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_rules [ 899.100601] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 899.100601] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c700070-2f87-44a9-8dfd-c57e5a935976 with Priority: HIGHEST for action port [ 899.100601] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.100601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.100601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.100601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.100601] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.101406] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.101496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.101532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.101678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.101957] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.101957] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.102085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.102119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.103421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.103421] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.103421] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c700070-2f87-44a9-8dfd-c57e5a935976 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.103421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c700070-2f87-44a9-8dfd-c57e5a935976" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.103421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c700070-2f87-44a9-8dfd-c57e5a935976" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.103421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c700070-2f87-44a9-8dfd-c57e5a935976" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.103421] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c700070-2f87-44a9-8dfd-c57e5a935976',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.164282] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 879b3713-7487-492d-b6e1-77747451fce3 in Status: SUCCESS [ 899.164503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.164669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.164953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.165105] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.165192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.165242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.165813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.165813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.165813] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('879b3713-7487-492d-b6e1-77747451fce3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.452845] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.454210] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.605150] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.605362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.605550] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c700070-2f87-44a9-8dfd-c57e5a935976 with status ACTIVE [ 899.605740] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.605852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.605921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.606496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.606496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.606496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.606496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.606944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.606944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.606944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.606944] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.607166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.607166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.607260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.607297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.607358] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c700070-2f87-44a9-8dfd-c57e5a935976 is going to be updated. [ 899.608480] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.633877] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.633877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.633877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.633877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.634153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.634388] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c700070-2f87-44a9-8dfd-c57e5a935976" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.668636] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('879b3713-7487-492d-b6e1-77747451fce3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.957545] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.957545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.957545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.957819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.957879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.958099] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 is going to be updated. [ 899.959548] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.959548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.959548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.959757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.959789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.960083] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 899.991274] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.991412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.991412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.991617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.991762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.994290] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.994535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.994609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.995702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.995702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.008258] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: IN_PROGRESS for 2s [ 900.009118] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 900.069502] env[67003]: INFO networking_nsxv3.common.synchronization [req-f8e88c02-ddce-4b41-9557-07678fe600ed req-4cae8a4c-ae08-4345-8026-05d2adc62d4e tempest-ImagesTestJSON-830230457 tempest-ImagesTestJSON-830230457-project-member] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 900.070087] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 900.071256] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.071256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.071256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.071256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.071256] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.071256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.071256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.071256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.071717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.071717] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.091376] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 in Status: SUCCESS [ 900.091595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.092700] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.092979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.093186] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.093305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.093427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.093541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.093623] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.093706] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.093793] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f2e25f5a-d04c-463f-a7f6-17866b02d583',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.111724] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.171203] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('879b3713-7487-492d-b6e1-77747451fce3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.430531] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-423 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.430793] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.431098] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.431476] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.431787] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.432756] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.432937] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.433247] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.436081] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.436366] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.436532] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 900.436704] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 900.436825] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 900.436955] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 900.437082] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 900.437222] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 900.456426] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 900.456629] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 900.456843] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 900.457051] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.457374] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-1028b361-ba1f-4c9f-8fa4-1e51ed98e853 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.457553] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-1028b361-ba1f-4c9f-8fa4-1e51ed98e853" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.457706] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-1028b361-ba1f-4c9f-8fa4-1e51ed98e853" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.458033] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-1028b361-ba1f-4c9f-8fa4-1e51ed98e853" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.458179] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1028b361-ba1f-4c9f-8fa4-1e51ed98e853',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.574311] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.574475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.574547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.574764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.574853] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.575059] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.575159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.575221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.575395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.575472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.575559] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 900.597262] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f2e25f5a-d04c-463f-a7f6-17866b02d583',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.600138] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.600305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.600352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.600600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.600752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.612863] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 900.615581] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.615727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.615805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.616070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.616164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.616260] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be created. [ 900.649939] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.650804] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.651129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.652571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.653180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.662726] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: UNINITIALIZED for 2s [ 900.675779] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.675779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.675779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.675779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.675779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.675779] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 879b3713-7487-492d-b6e1-77747451fce3 is going to be updated. [ 900.707503] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.707680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.707803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.707992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.708173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.717681] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 879b3713-7487-492d-b6e1-77747451fce3 in Status: IN_PROGRESS for 2s [ 900.961382] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.961626] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.961760] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.962056] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.962205] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.962369] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 1028b361-ba1f-4c9f-8fa4-1e51ed98e853 not found, creating... [ 900.962703] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.962864] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.963018] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.963375] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.963643] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.963980] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.964423] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.964653] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.965210] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.965475] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.965661] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 1028b361-ba1f-4c9f-8fa4-1e51ed98e853 is going to be created. [ 900.986782] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.987012] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.987142] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.987405] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.987626] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.987847] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-1028b361-ba1f-4c9f-8fa4-1e51ed98e853" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.099698] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f2e25f5a-d04c-463f-a7f6-17866b02d583: rpc.has_security_group_logging(os_id): False [ 901.124958] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.125260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.125260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.125637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.125637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.127481] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.127481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.127481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.127981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.127981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.128056] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 is going to be created. [ 901.209058] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.209247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.209375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.209522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.209661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.224546] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 in Status: IN_PROGRESS for 2s [ 901.778677] env[67003]: INFO networking_nsxv3.common.synchronization [req-f8e88c02-ddce-4b41-9557-07678fe600ed req-8c61b7c3-5a6b-4559-bf88-6700efd94c13 service nova] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_rules [ 901.778871] env[67003]: INFO networking_nsxv3.common.synchronization [req-f8e88c02-ddce-4b41-9557-07678fe600ed req-8c61b7c3-5a6b-4559-bf88-6700efd94c13 service nova] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 901.778994] env[67003]: INFO networking_nsxv3.common.synchronization [req-f8e88c02-ddce-4b41-9557-07678fe600ed req-8c61b7c3-5a6b-4559-bf88-6700efd94c13 service nova] Enqueued Resource ID: 1028b361-ba1f-4c9f-8fa4-1e51ed98e853 with Priority: HIGHEST for action port [ 901.779656] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_rules [ 901.779804] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 901.779904] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1028b361-ba1f-4c9f-8fa4-1e51ed98e853 with Priority: HIGHEST for action port [ 901.780224] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.780351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.780421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.780703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.780815] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.782793] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.782909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.783210] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-1028b361-ba1f-4c9f-8fa4-1e51ed98e853 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.783510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1028b361-ba1f-4c9f-8fa4-1e51ed98e853" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.783622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1028b361-ba1f-4c9f-8fa4-1e51ed98e853" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.783921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1028b361-ba1f-4c9f-8fa4-1e51ed98e853" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.784058] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1028b361-ba1f-4c9f-8fa4-1e51ed98e853',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.022055] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 902.022055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.022055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.022361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.022491] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.022606] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.022676] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.023607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.023750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.023864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.024157] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.025821] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: SUCCESS [ 902.026148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.026377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.026586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.027496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.027496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.027496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.027496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.027496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.027496] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.029054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.029054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.029054] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.029054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.029054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.029054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.029054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.029438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.029438] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.030661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.030875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.031589] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.031589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.031589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.031589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.031589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.031589] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.287429] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.287823] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.289269] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1028b361-ba1f-4c9f-8fa4-1e51ed98e853 with status ACTIVE [ 902.289344] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.289498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.289586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.290445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.290445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.290445] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.290445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.290715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.290762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.290887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.291235] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.291380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.291443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.291671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.291806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.292196] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1028b361-ba1f-4c9f-8fa4-1e51ed98e853 is going to be updated. [ 902.314986] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.315145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.315229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.315539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.315630] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.315796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1028b361-ba1f-4c9f-8fa4-1e51ed98e853" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.531250] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.532816] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.532816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.533104] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.533772] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.623768] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 902.623951] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 deletion is rescheduled due to dependency. [ 902.624089] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.624258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.624473] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.624667] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.624779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.624844] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.625018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.625083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.625704] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.671997] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: UNINITIALIZED for 4s [ 902.726463] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 879b3713-7487-492d-b6e1-77747451fce3 in Status: SUCCESS [ 902.726868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.726932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.727146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.727340] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.727459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.727527] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.727681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.727761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.727846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.727941] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('879b3713-7487-492d-b6e1-77747451fce3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.034642] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.036294] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea11303f-c0fb-4922-8c26-9eb29fdbf672: rpc.has_security_group_logging(os_id): False [ 903.037340] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.057236] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.057710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.057710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.057850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.057895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.058149] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.058252] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.058315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.058470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.058549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.058637] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 is going to be created. [ 903.113888] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.114077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.114124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.114317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.114491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.127886] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.133310] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: IN_PROGRESS for 2s [ 903.230013] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('879b3713-7487-492d-b6e1-77747451fce3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.240573] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 in Status: SUCCESS [ 903.240919] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.536651] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.537210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.537210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.537210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.537210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.537396] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 903.541310] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.541459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.541536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.541751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.541885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.541989] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 is going to be updated. [ 903.610067] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.610067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.610067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.610067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.610381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.614250] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.614250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.614250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.614250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.614250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.628428] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: IN_PROGRESS for 2s [ 903.629662] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 903.634797] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.732891] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 879b3713-7487-492d-b6e1-77747451fce3: rpc.has_security_group_logging(os_id): False [ 903.788111] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.788307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.788508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.788795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.788795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.789264] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.789411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.789485] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.789714] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.789819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.790014] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 879b3713-7487-492d-b6e1-77747451fce3 is going to be created. [ 903.933224] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.933481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.933596] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.933753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.933939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.952595] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 879b3713-7487-492d-b6e1-77747451fce3 in Status: IN_PROGRESS for 2s [ 904.137823] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.138022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.138064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.138290] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.138382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.138483] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 904.180186] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.180377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.180531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.180674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.180747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.194033] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 904.682110] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 904.682464] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.682560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.682794] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.682995] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.683118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.683188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.683357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.683434] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.683521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.683612] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.148035] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: SUCCESS [ 905.148035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.148232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.148452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.148579] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.186769] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.186936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.187019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.187226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.187545] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.187738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.187738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.187949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.188059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.188157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.188362] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.188486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.188559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.188769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.188896] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.188961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.189087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.189169] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.189251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.189351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.189454] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.206567] env[67003]: INFO networking_nsxv3.common.synchronization [req-29de686a-5a90-4af3-8b6c-662aa625ba88 req-9357cc0f-3c31-4c1a-8640-bef2efb6efaf tempest-ServerTagsTestJSON-1527641794 tempest-ServerTagsTestJSON-1527641794-project-member] Enqueued Resource ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 with Priority: HIGHEST for action security_group_members [ 905.207138] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 with Priority: HIGHEST for action security_group_members [ 905.207483] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9af6be1-7f4c-49d6-8fab-b97bada50e98 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.207614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.207683] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.207953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.208125] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.208229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.208293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.208452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.208535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.208696] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9af6be1-7f4c-49d6-8fab-b97bada50e98',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.572514] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.572846] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-295" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.572932] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-295" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.573296] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-295" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.573645] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.573930] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.574145] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.574294] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.574463] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.575074] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.575074] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 905.575074] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 905.575074] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 905.575674] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 905.575674] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 905.575674] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 905.598118] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 905.598314] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 905.598464] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 905.598744] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-295" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.599167] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-f93fa11a-098e-4554-a5b7-4801907baf5e taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.599540] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-f93fa11a-098e-4554-a5b7-4801907baf5e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.599685] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-f93fa11a-098e-4554-a5b7-4801907baf5e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.600049] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-f93fa11a-098e-4554-a5b7-4801907baf5e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.600207] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f93fa11a-098e-4554-a5b7-4801907baf5e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.643213] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: SUCCESS [ 905.643529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.644180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.644384] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.644821] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.644947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.645022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.645200] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.645339] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.645477] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.647256] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 905.647336] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.647495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.647682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.647932] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.648093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.648171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.648322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.648407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.648516] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.652082] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea11303f-c0fb-4922-8c26-9eb29fdbf672 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.652082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.692424] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06d182ef-21b7-44fd-8cbf-2f35f7927435: rpc.has_security_group_logging(os_id): False [ 905.710815] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.711079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.711196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.711551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.711699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.712036] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.712220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.712332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.712603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.712747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.712898] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 already deleted. [ 905.713071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.725341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.725685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.725801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.726084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.726226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.726635] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.727851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.727851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.727851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.727851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.727851] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.727851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.727851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.727851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.727851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.728302] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.728302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.728302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.728495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.728526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.728630] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be created. [ 905.848527] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.848727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.848798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.848963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.849167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.863857] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 905.977067] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 879b3713-7487-492d-b6e1-77747451fce3 in Status: SUCCESS [ 905.977299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.103203] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.103453] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.103874] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.104603] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.105227] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.105227] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port f93fa11a-098e-4554-a5b7-4801907baf5e not found, creating... [ 906.105346] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.105534] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.105661] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.106294] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.106294] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.106538] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.106722] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.106869] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.107113] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.107261] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.107410] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: f93fa11a-098e-4554-a5b7-4801907baf5e is going to be created. [ 906.134435] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.134435] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.134435] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.134435] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.134603] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.134767] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-f93fa11a-098e-4554-a5b7-4801907baf5e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.150799] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.151429] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.210850] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 906.211210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.211388] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.211647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.211893] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.212287] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.212393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.212496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.212579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.212713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.212817] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.653024] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.654114] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.714982] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.715505] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.715505] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.715808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.716086] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.716243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.716349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.716610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.716761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.716907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.717106] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.717215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.717278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.717516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.717822] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.717993] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.718279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.718571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.718749] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.718925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.719128] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.902886] env[67003]: INFO networking_nsxv3.common.synchronization [req-29de686a-5a90-4af3-8b6c-662aa625ba88 req-4aa6b149-cec8-48cb-be95-2dae3f177261 service nova] Enqueued Resource ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 with Priority: HIGHEST for action security_group_rules [ 906.903090] env[67003]: INFO networking_nsxv3.common.synchronization [req-29de686a-5a90-4af3-8b6c-662aa625ba88 req-4aa6b149-cec8-48cb-be95-2dae3f177261 service nova] Enqueued Resource ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 with Priority: HIGHEST for action security_group_members [ 906.903234] env[67003]: INFO networking_nsxv3.common.synchronization [req-29de686a-5a90-4af3-8b6c-662aa625ba88 req-4aa6b149-cec8-48cb-be95-2dae3f177261 service nova] Enqueued Resource ID: f93fa11a-098e-4554-a5b7-4801907baf5e with Priority: HIGHEST for action port [ 906.903892] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 with Priority: HIGHEST for action security_group_rules [ 906.904067] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 with Priority: HIGHEST for action security_group_members [ 906.904207] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f93fa11a-098e-4554-a5b7-4801907baf5e with Priority: HIGHEST for action port [ 906.904523] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9af6be1-7f4c-49d6-8fab-b97bada50e98 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.904663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.904703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.904961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.905060] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9af6be1-7f4c-49d6-8fab-b97bada50e98',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.906143] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9af6be1-7f4c-49d6-8fab-b97bada50e98 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.906253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.906314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.906486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.908294] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.908294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.908294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.908294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.908294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.908294] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9af6be1-7f4c-49d6-8fab-b97bada50e98',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.908294] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-f93fa11a-098e-4554-a5b7-4801907baf5e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.908294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f93fa11a-098e-4554-a5b7-4801907baf5e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.908294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f93fa11a-098e-4554-a5b7-4801907baf5e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.908294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f93fa11a-098e-4554-a5b7-4801907baf5e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.908662] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f93fa11a-098e-4554-a5b7-4801907baf5e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.155894] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.156946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.157034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.157306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.162021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.162021] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 is going to be updated. [ 907.162021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.162021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.162021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.162021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.162021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.162021] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 907.196145] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.196145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.196145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.196145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.196145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.197300] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.197456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.197545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.197782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.197946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.209609] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: IN_PROGRESS for 2s [ 907.210672] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 907.222897] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c06f8726-ef82-4058-ad8d-7e0aabd079e1: rpc.has_security_group_logging(os_id): False [ 907.241983] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.242167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.242210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.242414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.242570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.242814] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.242915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.243229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.243450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.243542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.243842] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.243910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.243939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.244104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.244176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.244365] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.244503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.244503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.244644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.244726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.244816] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 907.316977] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.317184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.317227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.317418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.317614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.332283] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 907.410387] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9af6be1-7f4c-49d6-8fab-b97bada50e98 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.410660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.410815] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9af6be1-7f4c-49d6-8fab-b97bada50e98',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.412966] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f93fa11a-098e-4554-a5b7-4801907baf5e with status ACTIVE [ 907.412966] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.412966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.412966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.412966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.412966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.413867] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.413867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.413867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.413867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.413867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.414083] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.414083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.414161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.414782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.414782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.414782] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f93fa11a-098e-4554-a5b7-4801907baf5e is going to be updated. [ 907.444076] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.444182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.444429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.444530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.444600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.444758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f93fa11a-098e-4554-a5b7-4801907baf5e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.876961] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 907.877265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.917959] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9af6be1-7f4c-49d6-8fab-b97bada50e98',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.420810] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.421016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.421107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.421333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.421419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.421518] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 is going to be created. [ 908.458916] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.458916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.458916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.458916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.458916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.469105] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 in Status: UNINITIALIZED for 2s [ 909.222392] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 909.222643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.223268] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: SUCCESS [ 909.223514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.223844] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.224151] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.224726] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.224866] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.225174] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.225174] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.225310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.225310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.225505] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.225612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.225680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.225824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.225963] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.226069] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.226132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.226265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.226336] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.226416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.226509] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.227360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.227687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.227899] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.228013] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.228115] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.228227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.228327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.228419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.228545] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.348543] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 909.348772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.591129] env[67003]: INFO networking_nsxv3.common.synchronization [req-5b62c208-8bd6-4e6d-bbe0-2679739739c4 req-6f289ead-b0bf-4b27-b689-5519ead21170 tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_members [ 909.591310] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_members [ 909.591619] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.591741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.592639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.592982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.593187] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.593298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.593371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.593538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.593619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.593719] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.733861] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc04636e-53f4-4929-8ae4-d13a910a1d84: rpc.has_security_group_logging(os_id): False [ 909.733861] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.766042] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.766042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.766042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.766042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.766042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.766042] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.766042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.766042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.766042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.766042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.766042] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.767828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.770996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.770996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.770996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.770996] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.770996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.770996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.770996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.770996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.770996] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 909.851651] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.851808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.851880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.852153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.852318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.870665] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 910.042847] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.042847] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.043131] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.045380] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.045579] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.045803] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.047012] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.047012] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.047012] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.047012] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.047012] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.047012] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.047012] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.047445] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.047445] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.047532] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.067173] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.067475] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.067563] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.067702] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.068107] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-e0eb6f91-a3f2-42ee-8603-2f1ca2eff337 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.068282] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-e0eb6f91-a3f2-42ee-8603-2f1ca2eff337" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.068407] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-e0eb6f91-a3f2-42ee-8603-2f1ca2eff337" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.068852] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-e0eb6f91-a3f2-42ee-8603-2f1ca2eff337" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.068936] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0eb6f91-a3f2-42ee-8603-2f1ca2eff337',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.096397] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.096564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.096622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.096839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.096927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.097138] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.097239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.097298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.097446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.097523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.097604] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55872268-81d2-4523-87e7-e00ce5194127 already deleted. [ 910.097685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.240516] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ea11303f-c0fb-4922-8c26-9eb29fdbf672: rpc.has_security_group_logging(os_id): False [ 910.262429] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.262578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.262638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.262843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.262936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.263172] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.263281] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.263395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.263518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.265487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.265487] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 is going to be updated. [ 910.322263] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.323256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.323256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.323256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.323256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.331252] env[67003]: INFO networking_nsxv3.common.synchronization [req-0f96e251-39fa-429e-b143-1160342ff98a req-4675d953-6954-476d-9601-816d52cf5892 tempest-ServersAdminNegativeTestJSON-1891119767 tempest-ServersAdminNegativeTestJSON-1891119767-project-member] Enqueued Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_members [ 910.331791] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGHEST for action security_group_members [ 910.332118] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.332236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.332303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.332564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.332657] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.332761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.333030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.334029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.334029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.334029] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.339869] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: IN_PROGRESS for 2s [ 910.479498] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 in Status: SUCCESS [ 910.479887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.480127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.480468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.480721] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.480880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.481051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.481306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.481428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.481549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.481817] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9af6be1-7f4c-49d6-8fab-b97bada50e98',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.572000] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.572154] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.572532] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.572640] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.576022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.576022] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port e0eb6f91-a3f2-42ee-8603-2f1ca2eff337 not found, creating... [ 910.576022] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.576022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.576022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.576022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.576022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.576022] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.576022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.576022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.576573] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.576573] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.576573] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: e0eb6f91-a3f2-42ee-8603-2f1ca2eff337 is going to be created. [ 910.597990] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.598910] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.599194] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.599571] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.599852] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.600182] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-e0eb6f91-a3f2-42ee-8603-2f1ca2eff337" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.835657] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.835802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.835802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.836206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.836206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.836315] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.836420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.836499] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.836695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.836776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.836866] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc is going to be updated. [ 910.875990] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.875990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.876309] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.876309] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.876413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.887526] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: IN_PROGRESS for 2s [ 910.985341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9af6be1-7f4c-49d6-8fab-b97bada50e98 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.985341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.985341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.985341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.985341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.985341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.985341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.985771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.985821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.986042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.986104] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9af6be1-7f4c-49d6-8fab-b97bada50e98 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.986194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.986251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.986428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.986631] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.986774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.986848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.986996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.987103] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.987207] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.987307] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9af6be1-7f4c-49d6-8fab-b97bada50e98',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.373106] env[67003]: INFO networking_nsxv3.common.synchronization [req-5b62c208-8bd6-4e6d-bbe0-2679739739c4 req-c086c443-0fae-4d9a-86b8-6a25c674499d service nova] Enqueued Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_rules [ 911.373401] env[67003]: INFO networking_nsxv3.common.synchronization [req-5b62c208-8bd6-4e6d-bbe0-2679739739c4 req-c086c443-0fae-4d9a-86b8-6a25c674499d service nova] Enqueued Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_members [ 911.373631] env[67003]: INFO networking_nsxv3.common.synchronization [req-5b62c208-8bd6-4e6d-bbe0-2679739739c4 req-c086c443-0fae-4d9a-86b8-6a25c674499d service nova] Enqueued Resource ID: e0eb6f91-a3f2-42ee-8603-2f1ca2eff337 with Priority: HIGHEST for action port [ 911.374393] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_rules [ 911.374567] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_members [ 911.374704] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0eb6f91-a3f2-42ee-8603-2f1ca2eff337 with Priority: HIGHEST for action port [ 911.375090] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.375355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.375504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.375854] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.375980] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.379105] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.379105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.379105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.379105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.379105] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.379105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.379105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.379105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.379105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.379105] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.379951] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0eb6f91-a3f2-42ee-8603-2f1ca2eff337 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.380208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0eb6f91-a3f2-42ee-8603-2f1ca2eff337" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.380208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0eb6f91-a3f2-42ee-8603-2f1ca2eff337" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.380348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0eb6f91-a3f2-42ee-8603-2f1ca2eff337" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.380536] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0eb6f91-a3f2-42ee-8603-2f1ca2eff337',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.489296] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9af6be1-7f4c-49d6-8fab-b97bada50e98: rpc.has_security_group_logging(os_id): False [ 911.511143] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.511378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.511378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.512085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.512085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.512085] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.512085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.512340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.512340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.512403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.512645] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.512645] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.512727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.513130] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.513130] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.513130] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.513296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.513296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.513455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.513552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.513640] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 is going to be created. [ 911.598674] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.598881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.598881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.599279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.599356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.613432] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 in Status: IN_PROGRESS for 2s [ 911.882695] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.884171] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.884297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.884448] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0eb6f91-a3f2-42ee-8603-2f1ca2eff337 with status ACTIVE [ 911.884611] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.884713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.884773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.884976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.885076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.885240] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.885336] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.885397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.885635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.885707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.885888] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.885981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.886047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.886188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.886264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.886346] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0eb6f91-a3f2-42ee-8603-2f1ca2eff337 is going to be updated. [ 911.888223] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 911.888577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.888577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.888699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.888780] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.912834] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.912987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.913077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.913279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.913551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.913744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0eb6f91-a3f2-42ee-8603-2f1ca2eff337" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.311201] env[67003]: INFO networking_nsxv3.common.synchronization [req-20ba3b80-5531-4523-a26e-19de5d4cdb95 req-e58dfcba-3658-4af9-aeb2-f1c4c94e41ed tempest-ServerActionsTestJSON-1949922754 tempest-ServerActionsTestJSON-1949922754-project-member] Enqueued Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGHEST for action security_group_members [ 912.312155] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGHEST for action security_group_members [ 912.312155] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-993ce117-521f-4677-9ad6-2a219a7366c9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.312365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.312365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.312513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.312668] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.312767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.312831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.312978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.313080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.313173] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.354191] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: SUCCESS [ 912.354463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.388413] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.390492] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.390492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.390851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.390851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.390952] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.391082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.391155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.391331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.391496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.391580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.391666] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.653457] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.657026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.657026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.657026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.657026] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.657026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.657026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.657026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.657026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.657026] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.657026] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.657026] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.657026] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.657026] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.657026] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.657026] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.687137] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.687371] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 912.687520] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.687813] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.688206] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-1110bcb4-5ca7-4298-ad1b-e0898a1db94f taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.688410] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-1110bcb4-5ca7-4298-ad1b-e0898a1db94f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.688550] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-1110bcb4-5ca7-4298-ad1b-e0898a1db94f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.688888] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-1110bcb4-5ca7-4298-ad1b-e0898a1db94f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.689055] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1110bcb4-5ca7-4298-ad1b-e0898a1db94f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.816533] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.816760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.817049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.817347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.817469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.817688] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.817797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.817862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.818043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.818122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.818207] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 993ce117-521f-4677-9ad6-2a219a7366c9 already deleted. [ 912.818285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.890713] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.890935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.891285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.891644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.891744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.891976] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55872268-81d2-4523-87e7-e00ce5194127 is going to be created. [ 912.894047] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.894225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.894274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.894502] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.894742] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.894874] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.894915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.895125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.895236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.895350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.895565] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.895679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.895767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.895941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.896172] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.896292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.896352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.896535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.896638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.896738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.896878] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.909974] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc in Status: SUCCESS [ 912.915415] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc deletion is rescheduled due to dependency. [ 912.915415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.944549] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.944741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.945771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.945771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.945771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.959712] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: UNINITIALIZED for 2s [ 913.193044] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.193290] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.193441] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.193725] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.193874] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.194038] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 1110bcb4-5ca7-4298-ad1b-e0898a1db94f not found, creating... [ 913.194307] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.194465] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.194585] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.194801] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.194977] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.195287] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.195468] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.195587] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.195800] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.195942] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.196791] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 1110bcb4-5ca7-4298-ad1b-e0898a1db94f is going to be created. [ 913.226138] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.226138] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.226138] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.226806] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.226806] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.226806] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-1110bcb4-5ca7-4298-ad1b-e0898a1db94f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.400017] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc04636e-53f4-4929-8ae4-d13a910a1d84: rpc.has_security_group_logging(os_id): False [ 913.426084] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.426246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.426305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.426608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.426751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.427054] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.427241] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.427405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.427587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.427687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.427933] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.428634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.428634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.428634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.428634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.428852] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.428852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.428852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.429111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.429111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.429200] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 913.518416] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.518682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.518871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.519186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.519412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.539055] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 913.675964] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 in Status: SUCCESS [ 913.676116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.995353] env[67003]: INFO networking_nsxv3.common.synchronization [req-20ba3b80-5531-4523-a26e-19de5d4cdb95 req-5c8657d4-e409-4d7b-9a2a-c4159c2d4189 service nova] Enqueued Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGHEST for action security_group_rules [ 913.995673] env[67003]: INFO networking_nsxv3.common.synchronization [req-20ba3b80-5531-4523-a26e-19de5d4cdb95 req-5c8657d4-e409-4d7b-9a2a-c4159c2d4189 service nova] Enqueued Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGHEST for action security_group_members [ 913.995839] env[67003]: INFO networking_nsxv3.common.synchronization [req-20ba3b80-5531-4523-a26e-19de5d4cdb95 req-5c8657d4-e409-4d7b-9a2a-c4159c2d4189 service nova] Enqueued Resource ID: 1110bcb4-5ca7-4298-ad1b-e0898a1db94f with Priority: HIGHEST for action port [ 913.996393] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGHEST for action security_group_rules [ 913.996590] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGHEST for action security_group_members [ 913.996698] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1110bcb4-5ca7-4298-ad1b-e0898a1db94f with Priority: HIGHEST for action port [ 913.996992] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-993ce117-521f-4677-9ad6-2a219a7366c9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.997163] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.997237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.997456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.997541] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.999042] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-993ce117-521f-4677-9ad6-2a219a7366c9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.999153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.999222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.999415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.999566] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.999683] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.999716] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.999875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.999959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.001045] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.002078] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-1110bcb4-5ca7-4298-ad1b-e0898a1db94f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.002078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1110bcb4-5ca7-4298-ad1b-e0898a1db94f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.002078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1110bcb4-5ca7-4298-ad1b-e0898a1db94f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.002078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1110bcb4-5ca7-4298-ad1b-e0898a1db94f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.002078] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1110bcb4-5ca7-4298-ad1b-e0898a1db94f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.487538] env[67003]: INFO networking_nsxv3.common.synchronization [req-b5317eb3-8380-4ad5-b663-99736740877f req-2c5074b0-aec4-428c-8a76-ec2990f52d43 tempest-ServersWithSpecificFlavorTestJSON-1477718790 tempest-ServersWithSpecificFlavorTestJSON-1477718790-project-member] Enqueued Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_members [ 914.488117] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGHEST for action security_group_members [ 914.488489] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.488605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.488679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.488828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.489079] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.489079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.489280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.489280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.489383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.489442] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.501747] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.503225] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-993ce117-521f-4677-9ad6-2a219a7366c9 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.503334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.503529] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1110bcb4-5ca7-4298-ad1b-e0898a1db94f with status ACTIVE [ 914.503699] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.505408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.505408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.506039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.506142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.506340] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.506456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.506524] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.506726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.506813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.507010] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.507121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.507185] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.507337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.507418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.507526] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1110bcb4-5ca7-4298-ad1b-e0898a1db94f is going to be updated. [ 914.531186] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.531342] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.531446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.531649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.531760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.531921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1110bcb4-5ca7-4298-ad1b-e0898a1db94f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.970716] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: SUCCESS [ 914.970961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.971154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.971629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.971866] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.971992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.972075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.972239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.972316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.972401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.972490] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.991665] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.991828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.991878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.992132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.992219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.992535] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.992660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.992727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.992888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.992967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.993058] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 is going to be updated. [ 915.004663] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.021496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.021717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.021717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.022021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.022236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.032625] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24c47389-894a-46a4-ac4e-16c5bd995856 in Status: IN_PROGRESS for 2s [ 915.062547] env[67003]: INFO networking_nsxv3.common.synchronization [req-edb6c38c-0da8-4a3b-b168-bfc608095be7 req-64de0feb-9150-41f7-bb30-f32640c277d8 tempest-ImagesOneServerNegativeTestJSON-533995407 tempest-ImagesOneServerNegativeTestJSON-533995407-project-member] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 915.063750] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 915.063984] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.064265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.064265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.064411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.064594] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.064704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.064768] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.064951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.065249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.065249] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.442924] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-784 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.444093] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-784" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.444387] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-784" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.444814] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-784" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.445276] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.445634] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.445848] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.446491] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.446491] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.446491] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.446815] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 915.448638] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 915.448638] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 915.448638] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 915.448638] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 915.448638] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 915.469451] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 915.469680] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 915.469859] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 915.470069] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-784" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.470518] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-59279695-c268-4526-ab3e-84224ae2bdf1 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.470795] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-59279695-c268-4526-ab3e-84224ae2bdf1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.472132] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-59279695-c268-4526-ab3e-84224ae2bdf1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.472132] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-59279695-c268-4526-ab3e-84224ae2bdf1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.472132] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59279695-c268-4526-ab3e-84224ae2bdf1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.474203] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.474427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.474638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.474900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.475193] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.475375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.475537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.476154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.476319] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.476466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.476714] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.477019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.477149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.480560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.480560] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.480560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.480560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.480560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.480560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.480560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.480560] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.506841] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.507142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.507142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.507269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.507354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.507449] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 993ce117-521f-4677-9ad6-2a219a7366c9 is going to be created. [ 915.531743] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.531894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.531960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.532182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.532335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.542434] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993ce117-521f-4677-9ad6-2a219a7366c9 in Status: UNINITIALIZED for 2s [ 915.556351] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 915.556817] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.567839] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.568886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.568886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.568886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.568886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.568886] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.568886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.568886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.569164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.569164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.569280] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be updated. [ 915.595601] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.595771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.595832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.596063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.596210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.610590] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: IN_PROGRESS for 2s [ 915.720726] env[67003]: INFO networking_nsxv3.common.synchronization [None req-25b34031-090b-4f67-841c-cdac7001f809 tempest-ServerRescueNegativeTestJSON-408866913 tempest-ServerRescueNegativeTestJSON-408866913-project-member] Enqueued Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGHEST for action security_group_rules [ 915.721487] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGHEST for action security_group_rules [ 915.721741] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cad76eb-924a-41f1-b865-f281dc96cec6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.721896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.721973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.722252] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.722341] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.908363] env[67003]: INFO networking_nsxv3.common.synchronization [None req-2fd5ba72-dfed-43a9-99dc-6a1dd0ea9c02 tempest-ServerRescueNegativeTestJSON-408866913 tempest-ServerRescueNegativeTestJSON-408866913-project-member] Enqueued Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGHEST for action security_group_rules [ 915.909250] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGHEST for action security_group_rules [ 915.909702] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cad76eb-924a-41f1-b865-f281dc96cec6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.909826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.974050] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.974387] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.974572] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.974990] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.975190] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.975368] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 59279695-c268-4526-ab3e-84224ae2bdf1 not found, creating... [ 915.975798] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.976080] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.976258] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.976694] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.976870] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.977396] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.977650] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.977832] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.978236] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.978422] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.978631] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 59279695-c268-4526-ab3e-84224ae2bdf1 is going to be created. [ 915.982172] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55872268-81d2-4523-87e7-e00ce5194127: rpc.has_security_group_logging(os_id): False [ 916.003736] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.004212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.004212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.004212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.004370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.004572] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.004669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.004733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.004897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.005065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.005177] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.005269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.005332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.005597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.005744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.006019] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.006165] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.006223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.006421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.006570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.006696] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55872268-81d2-4523-87e7-e00ce5194127 is going to be created. [ 916.009422] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.009636] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.009767] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.010021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.010277] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.010528] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-59279695-c268-4526-ab3e-84224ae2bdf1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.100230] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.100475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.100475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.100677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.100874] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.124538] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: IN_PROGRESS for 2s [ 916.253877] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.254172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.254172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.254415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.254754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.254924] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 already deleted. [ 916.255172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.255963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.256240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.256393] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.727810] env[67003]: INFO networking_nsxv3.common.synchronization [req-edb6c38c-0da8-4a3b-b168-bfc608095be7 req-18c96bb9-18d9-4ba7-8255-3cc7231e8625 service nova] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_rules [ 916.727810] env[67003]: INFO networking_nsxv3.common.synchronization [req-edb6c38c-0da8-4a3b-b168-bfc608095be7 req-18c96bb9-18d9-4ba7-8255-3cc7231e8625 service nova] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 916.727810] env[67003]: INFO networking_nsxv3.common.synchronization [req-edb6c38c-0da8-4a3b-b168-bfc608095be7 req-18c96bb9-18d9-4ba7-8255-3cc7231e8625 service nova] Enqueued Resource ID: 59279695-c268-4526-ab3e-84224ae2bdf1 with Priority: HIGHEST for action port [ 916.728349] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_rules [ 916.728490] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 916.728587] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59279695-c268-4526-ab3e-84224ae2bdf1 with Priority: HIGHEST for action port [ 916.729195] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.729595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.729692] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.730560] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.730669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.730851] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-59279695-c268-4526-ab3e-84224ae2bdf1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.730995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59279695-c268-4526-ab3e-84224ae2bdf1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.731052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59279695-c268-4526-ab3e-84224ae2bdf1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.731393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59279695-c268-4526-ab3e-84224ae2bdf1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.731393] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59279695-c268-4526-ab3e-84224ae2bdf1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.791637] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.792420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.792420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.793212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.793420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.794099] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 already deleted. [ 916.794099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.043813] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 24c47389-894a-46a4-ac4e-16c5bd995856 in Status: SUCCESS [ 917.044092] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 deletion is rescheduled due to dependency. [ 917.044426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.234557] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.234557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.234557] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59279695-c268-4526-ab3e-84224ae2bdf1 with status ACTIVE [ 917.234557] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.234557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.234557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.234954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.234954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.235930] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.235930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.235930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.235930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.235930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.235930] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.235930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.235930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.235930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.236298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.236298] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59279695-c268-4526-ab3e-84224ae2bdf1 is going to be updated. [ 917.260507] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.260507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.260507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.260507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.260507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.260507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59279695-c268-4526-ab3e-84224ae2bdf1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.553012] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993ce117-521f-4677-9ad6-2a219a7366c9 in Status: SUCCESS [ 917.553137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.553302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.553517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.553780] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.553906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.553972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.554146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.554227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.554312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.554402] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 917.622588] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: SUCCESS [ 917.623553] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a deletion is rescheduled due to dependency. [ 917.623553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.623553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.623553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.623553] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.623792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.623792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.623908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.623908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.624040] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.057380] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.126852] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.142817] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: SUCCESS [ 918.143071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.561020] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 993ce117-521f-4677-9ad6-2a219a7366c9: rpc.has_security_group_logging(os_id): False [ 918.582633] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.582745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.582842] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.583489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.583489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.583489] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.583489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.583489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.584145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.584145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.584145] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 993ce117-521f-4677-9ad6-2a219a7366c9 is going to be created. [ 918.630771] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.653723] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.653798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.653873] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.654108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.654296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.667349] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 993ce117-521f-4677-9ad6-2a219a7366c9 in Status: IN_PROGRESS for 2s [ 919.133922] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.134471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.134471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.134558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.134652] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.134746] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be updated. [ 919.175213] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.175400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.175474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.175722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.176109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.186901] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: IN_PROGRESS for 2s [ 920.682530] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 993ce117-521f-4677-9ad6-2a219a7366c9 in Status: SUCCESS [ 920.684340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.070148] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ca23a59-3bf8-46f9-b828-164c52c9d531 req-7c715f8f-a92d-4212-b445-5d491dfd9bef tempest-ServerTagsTestJSON-1527641794 tempest-ServerTagsTestJSON-1527641794-project-member] Enqueued Resource ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 with Priority: HIGHEST for action security_group_members [ 921.070148] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 with Priority: HIGHEST for action security_group_members [ 921.070148] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9af6be1-7f4c-49d6-8fab-b97bada50e98 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.070148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.070148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.070148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.070148] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.070148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.070148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.070710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.070895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.071091] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9af6be1-7f4c-49d6-8fab-b97bada50e98',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.197710] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: SUCCESS [ 921.197944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.198140] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.198373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.198562] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.198684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.198758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.200033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.200033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.200033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.200033] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.573949] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.573949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.573949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.573949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.574277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.574277] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.574351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.574390] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.574614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.575082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.575082] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 is going to be updated. [ 921.628040] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.628040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.628040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.628040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.628353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.644241] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 in Status: IN_PROGRESS for 2s [ 921.701935] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.702344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.702344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.702633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.702849] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.703515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.703515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.703515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.703515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.703881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.703881] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.703881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.704063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.704237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.704490] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.704597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.704732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.704944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.705100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.705261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.705367] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.207700] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 94cc9917-b413-4c1b-9c52-44b1bbb1141a: rpc.has_security_group_logging(os_id): False [ 922.227297] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.227297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.227435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.227573] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.227696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.229031] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.229031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.229031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.229031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.229031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.229031] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.229031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.229031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.229031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.229031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.229031] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.229510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.229510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.229510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.229510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.229510] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be updated. [ 922.303952] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.304119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.304200] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.304805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.304805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.317904] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: IN_PROGRESS for 2s [ 923.655297] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 in Status: SUCCESS [ 923.655793] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 deletion is rescheduled due to dependency. [ 923.655793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.331486] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: SUCCESS [ 924.333257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.111959] env[67003]: INFO networking_nsxv3.common.synchronization [req-b4a0ee82-0f26-4df1-89d9-c6578a98dc01 req-ffc0a610-b73f-4d6d-9b7a-ab0d33125202 tempest-DeleteServersTestJSON-1342989894 tempest-DeleteServersTestJSON-1342989894-project-member] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 925.112600] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 925.113161] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.113815] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.113815] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.114010] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.114162] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.114247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.114732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.114732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.114732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.114732] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.618860] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.619102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.619200] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.619477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.619597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.619856] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.619985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.620087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.620300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.620402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.620517] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 925.652200] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.652396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.652464] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.652682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.652978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.672900] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 926.945210] env[67003]: INFO networking_nsxv3.common.synchronization [req-f1d5da3c-2982-4123-946c-6cb2a0070f04 req-17e2255f-52a5-4150-9c62-2d3817e686fc tempest-ServersAdminTestJSON-1432619756 tempest-ServersAdminTestJSON-1432619756-project-member] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 926.945848] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGHEST for action security_group_members [ 926.946228] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.946292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.946360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.946597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.946803] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.946918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.946980] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.947166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.947299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.947394] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.099841] env[67003]: INFO networking_nsxv3.common.synchronization [req-15b2649e-fcd5-47b8-aea5-3ae031a5185c req-61314516-7eef-4705-b281-6e50c487ad6a tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 927.100371] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 927.100683] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.100807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.100875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.101387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.101610] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.101769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.101933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.102113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.102319] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.102462] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.450063] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.450266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.450364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.450629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.450755] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.450992] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.451145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.451212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.451413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.451498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.451618] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be updated. [ 927.484367] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.484885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.484967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.485198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.485765] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.498769] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: IN_PROGRESS for 2s [ 927.516930] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-731 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.517175] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-731" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.517300] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-731" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.517627] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-731" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.518128] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.518128] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.518331] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.518395] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.518514] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.518721] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.518834] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 927.518941] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 927.519059] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 927.519197] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 927.519288] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 927.519388] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 927.539305] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 927.539488] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 927.539655] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 927.539881] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-731" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.540182] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.540397] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.540563] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.540797] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.541041] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cacd06de-bf2f-4c72-8bfd-79ed0f33c39f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.607035] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.607234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.607346] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.607638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.607735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.608650] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.608887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.608993] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.609293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.609412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.609528] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 already deleted. [ 927.609655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.683018] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 927.683197] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 deletion is rescheduled due to dependency. [ 927.683386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.043998] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.044387] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.044497] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.044784] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.044952] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.045122] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port cacd06de-bf2f-4c72-8bfd-79ed0f33c39f not found, creating... [ 928.045395] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.045607] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.045729] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.046042] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.046309] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.046575] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.046802] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.046907] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.047171] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.047321] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.047441] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: cacd06de-bf2f-4c72-8bfd-79ed0f33c39f is going to be created. [ 928.088067] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.088317] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.088363] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.088629] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.088858] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.089106] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.816553] env[67003]: INFO networking_nsxv3.common.synchronization [req-15b2649e-fcd5-47b8-aea5-3ae031a5185c req-4e201151-3727-4213-b7e8-1559558896e9 service nova] Enqueued Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_rules [ 928.816783] env[67003]: INFO networking_nsxv3.common.synchronization [req-15b2649e-fcd5-47b8-aea5-3ae031a5185c req-4e201151-3727-4213-b7e8-1559558896e9 service nova] Enqueued Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 928.816950] env[67003]: INFO networking_nsxv3.common.synchronization [req-15b2649e-fcd5-47b8-aea5-3ae031a5185c req-4e201151-3727-4213-b7e8-1559558896e9 service nova] Enqueued Resource ID: cacd06de-bf2f-4c72-8bfd-79ed0f33c39f with Priority: HIGHEST for action port [ 928.817521] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_rules [ 928.817680] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 928.817831] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacd06de-bf2f-4c72-8bfd-79ed0f33c39f with Priority: HIGHEST for action port [ 928.818162] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.818317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.818372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.818649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.818768] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.819865] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.819865] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.819951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.820158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.820343] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.820448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.820522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.820691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.820838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.820890] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.823757] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.823757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.823757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.823989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.823989] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cacd06de-bf2f-4c72-8bfd-79ed0f33c39f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.258043] env[67003]: INFO networking_nsxv3.common.synchronization [req-8e0482ff-f887-4a3d-9fd1-5c15f11022a0 req-814e3010-39bf-43d3-b4fb-387c8117f84d tempest-ImagesOneServerNegativeTestJSON-533995407 tempest-ImagesOneServerNegativeTestJSON-533995407-project-member] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 929.258551] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGHEST for action security_group_members [ 929.258860] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.258981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.259057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.259264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.259461] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.259568] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.259632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.259789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.259872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.260011] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.325808] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.326763] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.326887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.327023] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cacd06de-bf2f-4c72-8bfd-79ed0f33c39f with status ACTIVE [ 929.327199] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.327310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.327374] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.327571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.327657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.327823] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.327942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.328052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.328155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.328230] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.328404] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.328500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.328555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.328687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.328809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.328809] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cacd06de-bf2f-4c72-8bfd-79ed0f33c39f is going to be updated. [ 929.352440] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.352440] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.352440] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.352440] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.352704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.352704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.509165] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a47e002a-325f-4303-8dea-86209028ebb0 in Status: SUCCESS [ 929.509165] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a47e002a-325f-4303-8dea-86209028ebb0 deletion is rescheduled due to dependency. [ 929.509165] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.763649] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.765015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.765015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.765015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.765015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.765015] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.765015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.765015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.765015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.765015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.765015] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be updated. [ 929.795439] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.795622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.795701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.795948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.796107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.807702] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: IN_PROGRESS for 2s [ 929.831321] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.334717] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.334717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.334717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.334717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.334717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.334717] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 is going to be created. [ 930.366855] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.367094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.367154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.367354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.367578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.383767] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: UNINITIALIZED for 2s [ 931.462616] env[67003]: INFO networking_nsxv3.common.synchronization [req-29200ab5-49ca-4cc0-b6eb-49f4ec6157f3 req-fa44052a-d962-4b58-8075-8694772d66e5 tempest-ListServerFiltersTestJSON-449543784 tempest-ListServerFiltersTestJSON-449543784-project-member] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 931.463208] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGHEST for action security_group_members [ 931.463522] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.463664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.463735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.463972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.464138] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.464240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.464304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.464444] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.464530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.464622] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.819035] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a in Status: SUCCESS [ 931.819245] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a deletion is rescheduled due to dependency. [ 931.819417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.967382] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.967594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.967678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.967901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.968024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.968235] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.968339] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.968402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.968567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.968640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.968726] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 is going to be updated. [ 931.997688] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.997864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.999895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.999895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.999895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.012625] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: IN_PROGRESS for 2s [ 932.393890] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: SUCCESS [ 932.394128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.394296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.394504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.394694] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.394812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.394899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.395099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.395183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.395271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.395363] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.897674] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.898086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.898086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.898174] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.898283] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.898381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.898446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.898592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.898675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.898762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.898903] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.898994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.899084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.899222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.899358] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.899447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.899508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.899669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.899776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.899865] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.899954] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.401819] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ca7593b-6cf9-418e-9d37-bb09b986e001: rpc.has_security_group_logging(os_id): False [ 933.423226] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.423399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.423457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.423674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.423773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.424031] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.424157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.424228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.424420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.424511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.424866] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.424866] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.424989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.425118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.425226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.425447] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.425556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.425687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.425856] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.425956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.426084] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 is going to be created. [ 933.509114] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.509114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.509114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.509114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.509114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.525461] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: IN_PROGRESS for 2s [ 934.024913] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 in Status: SUCCESS [ 934.025201] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 deletion is rescheduled due to dependency. [ 934.025265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.370946] env[67003]: INFO networking_nsxv3.common.synchronization [req-35126f3a-9624-43e0-a73b-26d4a08a53f2 req-9f53b81a-df49-49b3-be0d-de981c0a050c tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 934.372028] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 934.372028] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.372028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.372028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.372278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.372278] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.372358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.372392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.372682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.372682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.372781] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.719426] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-851 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.719600] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-851" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.719903] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-851" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.720356] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-851" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.720784] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.721076] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.721306] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.721671] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.722027] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.722261] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.723026] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 934.723026] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 934.723026] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 934.723026] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 934.723266] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 934.723500] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 934.752517] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 934.752683] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 934.753405] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 934.753405] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-851" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.753405] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.753728] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.753728] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.753981] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.754142] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c2632e2-355c-49f4-8c25-95bc7e9df6cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.875810] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.259616] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.259616] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.259616] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.259616] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.259616] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.259616] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 0c2632e2-355c-49f4-8c25-95bc7e9df6cc not found, creating... [ 935.259616] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.260252] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.260252] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.260252] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.260357] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.260572] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.260730] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.260846] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.261527] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.261527] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.261527] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 0c2632e2-355c-49f4-8c25-95bc7e9df6cc is going to be created. [ 935.285941] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.286219] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.286376] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.286712] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.287074] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.287341] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.379057] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.537787] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: SUCCESS [ 935.538057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.881547] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.881821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.881877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.882248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.882434] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.882562] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 935.917568] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.917889] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.918053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.918403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.918663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.929738] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 936.068293] env[67003]: INFO networking_nsxv3.common.synchronization [req-35126f3a-9624-43e0-a73b-26d4a08a53f2 req-97aeab13-07be-4eeb-b0d7-ce72cc8ce0c5 service nova] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_rules [ 936.068464] env[67003]: INFO networking_nsxv3.common.synchronization [req-35126f3a-9624-43e0-a73b-26d4a08a53f2 req-97aeab13-07be-4eeb-b0d7-ce72cc8ce0c5 service nova] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 936.068652] env[67003]: INFO networking_nsxv3.common.synchronization [req-35126f3a-9624-43e0-a73b-26d4a08a53f2 req-97aeab13-07be-4eeb-b0d7-ce72cc8ce0c5 service nova] Enqueued Resource ID: 0c2632e2-355c-49f4-8c25-95bc7e9df6cc with Priority: HIGHEST for action port [ 936.069372] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_rules [ 936.069509] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 936.069610] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c2632e2-355c-49f4-8c25-95bc7e9df6cc with Priority: HIGHEST for action port [ 936.069881] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.070000] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.070136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.070535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.070535] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.071515] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.071617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.071819] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.071958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.072055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.072239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.072313] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c2632e2-355c-49f4-8c25-95bc7e9df6cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.574017] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.574402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.574662] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c2632e2-355c-49f4-8c25-95bc7e9df6cc with status ACTIVE [ 936.574948] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.575124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.575226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.575545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.575838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.576127] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.576272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.576367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.576884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.577032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.577314] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.577314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.577475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.577533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.577612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.577711] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c2632e2-355c-49f4-8c25-95bc7e9df6cc is going to be updated. [ 936.603396] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.603550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.603550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.603840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.604047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.604300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.944349] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 937.944349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.944349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.944349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.944349] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.944349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.944349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.944926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.944926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.944926] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.447226] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.949704] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.455023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.455023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.455023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.455023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.455023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.455023] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 939.488242] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.488242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.488242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.488242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.488242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.496735] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 939.686979] env[67003]: INFO networking_nsxv3.common.synchronization [req-5701049e-a600-4503-beb0-8a887d30bfe5 req-689bef9e-1597-4611-89d8-b10442899445 tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_members [ 939.686979] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_members [ 939.686979] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.686979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.686979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.686979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.686979] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.686979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.686979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.686979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.687359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.687553] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.190015] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.190271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.190271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.191156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.191156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.191156] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.191156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.191156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.191156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.191357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.191357] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55872268-81d2-4523-87e7-e00ce5194127 is going to be updated. [ 940.223835] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.224062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.224142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.224380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.224550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.238374] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: IN_PROGRESS for 2s [ 941.515760] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 941.515760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.515760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.515760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.516489] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.516489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.516489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.516809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.516949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.517183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.517355] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.020338] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.020556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.020664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.020961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.021216] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.021392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.021457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.021675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.021806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.021943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.022179] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.022321] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.022419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.022620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.022828] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.022968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.023098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.023304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.023417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.023560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.023668] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.251144] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: SUCCESS [ 942.251333] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55872268-81d2-4523-87e7-e00ce5194127 deletion is rescheduled due to dependency. [ 942.251401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.526706] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc04636e-53f4-4929-8ae4-d13a910a1d84: rpc.has_security_group_logging(os_id): False [ 942.545290] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.545454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.545454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.545639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.545758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.545963] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.546094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.546139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.546408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.546408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.546558] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.546655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.546716] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.546855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.546931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.547226] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.547226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.547350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.547414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.547489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.547574] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 942.571639] env[67003]: INFO networking_nsxv3.common.synchronization [req-51dd3974-a6d8-41e9-b167-436e4976fdc4 req-ab7d9fa1-ae55-4bf0-aadd-6d9f76eb8e87 tempest-ServersV294TestFqdnHostnames-1804776967 tempest-ServersV294TestFqdnHostnames-1804776967-project-member] Enqueued Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGHEST for action security_group_members [ 942.572110] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGHEST for action security_group_members [ 942.572413] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-0984692d-32cd-4b7f-9bd0-7496ca581278 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.572539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.572605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.572793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.572940] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.573191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.573274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.573432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.573516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.573669] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.618391] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.618391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.618391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.618391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.618391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.637643] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 943.077863] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.078155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.078155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.078387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.078759] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.078759] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.079075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.079075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.079075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.079075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.079201] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 is going to be updated. [ 943.114941] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.115231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.115231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.115431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.115538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.127784] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 in Status: IN_PROGRESS for 2s [ 944.655160] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 944.655504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.860556] env[67003]: INFO networking_nsxv3.common.synchronization [req-aba51169-cd81-467e-863e-66a55859e175 req-455f24ba-ecc1-4fd1-aaf0-8a4f2d5ed145 tempest-ServerRescueNegativeTestJSON-408866913 tempest-ServerRescueNegativeTestJSON-408866913-project-member] Enqueued Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGHEST for action security_group_members [ 944.860834] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGHEST for action security_group_members [ 944.861660] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cad76eb-924a-41f1-b865-f281dc96cec6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.861959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.862189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.862502] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.862820] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.863062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.863237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.863523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.863769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.863958] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.139426] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 in Status: SUCCESS [ 945.139603] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 deletion is rescheduled due to dependency. [ 945.139718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.321457] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-639 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.321759] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-639" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.321969] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-639" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.322354] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-639" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.322735] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.322942] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.323090] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.323547] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.324459] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.324459] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.324459] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.324459] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.324459] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.324459] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.324459] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.324776] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.345884] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.346093] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 945.346218] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.346393] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-639" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.346957] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-b945a217-7083-4053-b533-88fa09b844d0 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.346957] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-b945a217-7083-4053-b533-88fa09b844d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.347158] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-b945a217-7083-4053-b533-88fa09b844d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.347504] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-b945a217-7083-4053-b533-88fa09b844d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.347660] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b945a217-7083-4053-b533-88fa09b844d0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.370043] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.370043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.370202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.370309] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.370398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.370584] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.370682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.370744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.370890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.371138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.371193] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 already deleted. [ 945.371277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.850030] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.850499] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.850499] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.850770] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.850972] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.851207] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port b945a217-7083-4053-b533-88fa09b844d0 not found, creating... [ 945.851499] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.851686] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.851812] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.852097] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.852255] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.852596] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.852806] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.852948] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.853279] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.853427] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.853580] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: b945a217-7083-4053-b533-88fa09b844d0 is going to be created. [ 945.881358] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.881598] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.881718] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.882019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.882259] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.882500] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-b945a217-7083-4053-b533-88fa09b844d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.625935] env[67003]: INFO networking_nsxv3.common.synchronization [req-aba51169-cd81-467e-863e-66a55859e175 req-6b1bc096-f2b6-4048-a9b7-a6724f66f179 service nova] Enqueued Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGHEST for action security_group_rules [ 946.625935] env[67003]: INFO networking_nsxv3.common.synchronization [req-aba51169-cd81-467e-863e-66a55859e175 req-6b1bc096-f2b6-4048-a9b7-a6724f66f179 service nova] Enqueued Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGHEST for action security_group_members [ 946.626271] env[67003]: INFO networking_nsxv3.common.synchronization [req-aba51169-cd81-467e-863e-66a55859e175 req-6b1bc096-f2b6-4048-a9b7-a6724f66f179 service nova] Enqueued Resource ID: b945a217-7083-4053-b533-88fa09b844d0 with Priority: HIGHEST for action port [ 946.626565] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGHEST for action security_group_rules [ 946.626719] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGHEST for action security_group_members [ 946.626829] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b945a217-7083-4053-b533-88fa09b844d0 with Priority: HIGHEST for action port [ 946.627564] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cad76eb-924a-41f1-b865-f281dc96cec6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.627564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.627564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.627564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.627821] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.628806] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cad76eb-924a-41f1-b865-f281dc96cec6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.628919] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.628984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.629341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.629341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.629629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.629708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.629877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.630050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.630050] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.630873] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b945a217-7083-4053-b533-88fa09b844d0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.630975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b945a217-7083-4053-b533-88fa09b844d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.632790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b945a217-7083-4053-b533-88fa09b844d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.632790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b945a217-7083-4053-b533-88fa09b844d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.632790] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b945a217-7083-4053-b533-88fa09b844d0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.134218] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.135946] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cad76eb-924a-41f1-b865-f281dc96cec6 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.139022] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b945a217-7083-4053-b533-88fa09b844d0 with status ACTIVE [ 947.139022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.139022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.139022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.139022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.139973] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b945a217-7083-4053-b533-88fa09b844d0 is going to be updated. [ 947.161665] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.161882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.161882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.162186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.162335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.162523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b945a217-7083-4053-b533-88fa09b844d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.274714] env[67003]: INFO networking_nsxv3.common.synchronization [req-48023a7e-8791-4d2c-abd4-20f7f82f9c27 req-25534a83-2d02-40cc-a9d5-19521cc83114 tempest-ImagesTestJSON-830230457 tempest-ImagesTestJSON-830230457-project-member] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 947.275379] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 947.275806] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.275954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.277289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.277572] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.278726] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.278873] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.278941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.279208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.279265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.279366] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.637577] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.684349] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-423 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.684349] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.684349] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.684349] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.684882] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.685314] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.685635] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.686162] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.686510] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.687429] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.687715] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 947.687967] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 947.688419] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 947.688756] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 947.689052] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 947.689329] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 947.713970] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 947.713970] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 947.713970] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 947.713970] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.713970] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-bc37655b-2aa0-4731-a7f0-d84286079795 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.713970] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-bc37655b-2aa0-4731-a7f0-d84286079795" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.713970] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-bc37655b-2aa0-4731-a7f0-d84286079795" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.713970] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-bc37655b-2aa0-4731-a7f0-d84286079795" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.713970] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc37655b-2aa0-4731-a7f0-d84286079795',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.784100] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.140755] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.141073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.141073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.141236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.141351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.141468] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 is going to be created. [ 948.170640] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.170801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.170872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.171095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.171720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.182616] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 in Status: UNINITIALIZED for 2s [ 948.218293] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.218293] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.218293] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.218293] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.218293] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.218293] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port bc37655b-2aa0-4731-a7f0-d84286079795 not found, creating... [ 948.218293] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.218621] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.218621] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.218787] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.218925] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.219233] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.219389] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.219508] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.219716] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.219853] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.219993] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: bc37655b-2aa0-4731-a7f0-d84286079795 is going to be created. [ 948.242936] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.243145] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.243284] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.243581] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.243900] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.244169] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-bc37655b-2aa0-4731-a7f0-d84286079795" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.288830] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.792184] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.792339] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.792408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.792618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.792703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.792801] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 948.823746] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.823884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.823961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.824198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.825127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.834094] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 948.993989] env[67003]: INFO networking_nsxv3.common.synchronization [req-48023a7e-8791-4d2c-abd4-20f7f82f9c27 req-64ea2910-5624-420f-adbb-7521588d1a39 service nova] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_rules [ 948.994210] env[67003]: INFO networking_nsxv3.common.synchronization [req-48023a7e-8791-4d2c-abd4-20f7f82f9c27 req-64ea2910-5624-420f-adbb-7521588d1a39 service nova] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 948.994379] env[67003]: INFO networking_nsxv3.common.synchronization [req-48023a7e-8791-4d2c-abd4-20f7f82f9c27 req-64ea2910-5624-420f-adbb-7521588d1a39 service nova] Enqueued Resource ID: bc37655b-2aa0-4731-a7f0-d84286079795 with Priority: HIGHEST for action port [ 948.994835] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_rules [ 948.995077] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 948.995232] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bc37655b-2aa0-4731-a7f0-d84286079795 with Priority: HIGHEST for action port [ 948.995484] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.995568] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.995629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.995879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.995975] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.996981] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.997070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.997250] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-bc37655b-2aa0-4731-a7f0-d84286079795 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.997352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bc37655b-2aa0-4731-a7f0-d84286079795" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.997413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bc37655b-2aa0-4731-a7f0-d84286079795" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.997646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bc37655b-2aa0-4731-a7f0-d84286079795" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.997646] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bc37655b-2aa0-4731-a7f0-d84286079795',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.302546] env[67003]: INFO networking_nsxv3.common.synchronization [req-7c7a7b83-d207-47d6-833b-f0e81ffe695f req-ef2b641a-013a-45aa-8e02-73090c7cd835 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_members [ 949.302546] env[67003]: INFO networking_nsxv3.common.synchronization [req-7c7a7b83-d207-47d6-833b-f0e81ffe695f req-ef2b641a-013a-45aa-8e02-73090c7cd835 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 949.302546] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_members [ 949.302546] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 949.303699] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4863374-5c9e-490a-be11-1eac203337f7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.303699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.303699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.307018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.307018] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.307018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.307018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.307018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.307018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.307018] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.307018] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.307018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.307018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.307018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.307018] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.307018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.307018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.307018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.307018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.307018] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.347081] env[67003]: INFO networking_nsxv3.common.synchronization [req-7c7a7b83-d207-47d6-833b-f0e81ffe695f req-ef2b641a-013a-45aa-8e02-73090c7cd835 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_rules [ 949.349050] env[67003]: INFO networking_nsxv3.common.synchronization [req-7c7a7b83-d207-47d6-833b-f0e81ffe695f req-ef2b641a-013a-45aa-8e02-73090c7cd835 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_members [ 949.349050] env[67003]: INFO networking_nsxv3.common.synchronization [req-7c7a7b83-d207-47d6-833b-f0e81ffe695f req-ef2b641a-013a-45aa-8e02-73090c7cd835 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_rules [ 949.349050] env[67003]: INFO networking_nsxv3.common.synchronization [req-7c7a7b83-d207-47d6-833b-f0e81ffe695f req-ef2b641a-013a-45aa-8e02-73090c7cd835 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 949.349050] env[67003]: INFO networking_nsxv3.common.synchronization [req-7c7a7b83-d207-47d6-833b-f0e81ffe695f req-ef2b641a-013a-45aa-8e02-73090c7cd835 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: 0c2632e2-355c-49f4-8c25-95bc7e9df6cc with Priority: HIGHEST for action port [ 949.349050] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_rules [ 949.349050] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_rules [ 949.349050] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c2632e2-355c-49f4-8c25-95bc7e9df6cc with Priority: HIGHEST for action port [ 949.349050] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_members [ 949.349050] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 949.349050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4863374-5c9e-490a-be11-1eac203337f7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.349921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.350147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.350548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.350740] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.353084] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.353084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.353084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.353084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.353084] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.353084] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.353084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.353084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.353841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.354144] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c2632e2-355c-49f4-8c25-95bc7e9df6cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.354911] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4863374-5c9e-490a-be11-1eac203337f7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.355168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.357995] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.357995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.499471] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.499648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.499854] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bc37655b-2aa0-4731-a7f0-d84286079795 with status ACTIVE [ 949.500059] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.500220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.500251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.500704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.500704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.500812] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.500812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.500885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.501036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.501133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.501356] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.501462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.502399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.502399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.502399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.502399] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bc37655b-2aa0-4731-a7f0-d84286079795 is going to be updated. [ 949.526452] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.526608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.526677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.526976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.527174] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.527265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bc37655b-2aa0-4731-a7f0-d84286079795" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.810128] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.810866] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.858345] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c2632e2-355c-49f4-8c25-95bc7e9df6cc with status ACTIVE [ 949.858580] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.858729] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.858775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.858989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.859123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.859310] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.861493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.861493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.861493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.861493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.861493] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.861493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.861493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.861493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.861493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.861493] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c2632e2-355c-49f4-8c25-95bc7e9df6cc is going to be updated. [ 949.862070] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.862172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.862415] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4863374-5c9e-490a-be11-1eac203337f7 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.862490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.885601] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.885601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.885601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.885601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.885601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.885601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.193396] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 in Status: SUCCESS [ 950.193628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.193878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.194112] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.194309] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.194436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.194502] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.195897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.195998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.196128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.196225] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.314021] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.316024] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.699546] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.820440] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.820641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.821064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.821469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.821579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.821686] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4863374-5c9e-490a-be11-1eac203337f7 is going to be created. [ 950.822954] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.823094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.823288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.823463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.823552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.823643] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 950.852496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.852496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.852684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.852730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.853400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.855229] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 950.855815] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.855815] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.855815] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.855974] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.856092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.856144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.856563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.856563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.856563] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.857989] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.858249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.858249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.859328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.859328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.860803] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: UNINITIALIZED for 2s [ 950.866707] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 951.138824] env[67003]: INFO networking_nsxv3.common.synchronization [req-6011203b-7c1f-4dfd-b1fb-f026a74813f7 req-89781dc3-c612-433e-807d-4585f31c5ae8 tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: dd3699f9-0054-4c64-b6ca-b7703882a902 with Priority: HIGHEST for action security_group_members [ 951.139035] env[67003]: INFO networking_nsxv3.common.synchronization [req-6011203b-7c1f-4dfd-b1fb-f026a74813f7 req-89781dc3-c612-433e-807d-4585f31c5ae8 tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 951.139629] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3699f9-0054-4c64-b6ca-b7703882a902 with Priority: HIGHEST for action security_group_members [ 951.139772] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 951.140547] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3699f9-0054-4c64-b6ca-b7703882a902 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.140693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.140776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.141089] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.141354] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.141413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.141518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.141619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.141701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.141812] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd3699f9-0054-4c64-b6ca-b7703882a902',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.142749] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.142884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.142959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.143145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.143293] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.143405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.143472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.143642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.143738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.143859] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.202371] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cad76eb-924a-41f1-b865-f281dc96cec6: rpc.has_security_group_logging(os_id): False [ 951.228452] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.228660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.228730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.229315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.229315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.229315] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.229740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.229740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.229740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.229740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.229932] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 is going to be created. [ 951.233902] env[67003]: INFO networking_nsxv3.common.synchronization [req-6011203b-7c1f-4dfd-b1fb-f026a74813f7 req-89781dc3-c612-433e-807d-4585f31c5ae8 tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_rules [ 951.233902] env[67003]: INFO networking_nsxv3.common.synchronization [req-6011203b-7c1f-4dfd-b1fb-f026a74813f7 req-89781dc3-c612-433e-807d-4585f31c5ae8 tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 951.234150] env[67003]: INFO networking_nsxv3.common.synchronization [req-6011203b-7c1f-4dfd-b1fb-f026a74813f7 req-89781dc3-c612-433e-807d-4585f31c5ae8 tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: dd3699f9-0054-4c64-b6ca-b7703882a902 with Priority: HIGHEST for action security_group_rules [ 951.234150] env[67003]: INFO networking_nsxv3.common.synchronization [req-6011203b-7c1f-4dfd-b1fb-f026a74813f7 req-89781dc3-c612-433e-807d-4585f31c5ae8 tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: dd3699f9-0054-4c64-b6ca-b7703882a902 with Priority: HIGHEST for action security_group_members [ 951.234239] env[67003]: INFO networking_nsxv3.common.synchronization [req-6011203b-7c1f-4dfd-b1fb-f026a74813f7 req-89781dc3-c612-433e-807d-4585f31c5ae8 tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: cacd06de-bf2f-4c72-8bfd-79ed0f33c39f with Priority: HIGHEST for action port [ 951.235844] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_rules [ 951.236082] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3699f9-0054-4c64-b6ca-b7703882a902 with Priority: HIGHEST for action security_group_rules [ 951.236144] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacd06de-bf2f-4c72-8bfd-79ed0f33c39f with Priority: HIGHEST for action port [ 951.236257] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 951.236321] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3699f9-0054-4c64-b6ca-b7703882a902 with Priority: HIGHEST for action security_group_members [ 951.237034] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.237146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.237186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.238221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.238346] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.239680] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dd3699f9-0054-4c64-b6ca-b7703882a902 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.239680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.239680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.239935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.240051] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dd3699f9-0054-4c64-b6ca-b7703882a902',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.240977] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.241090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.241150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.242733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.242733] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cacd06de-bf2f-4c72-8bfd-79ed0f33c39f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.243769] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.243879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.246227] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3699f9-0054-4c64-b6ca-b7703882a902 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.246370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.304564] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.304735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.304786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.305021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.305237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.319162] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 in Status: IN_PROGRESS for 2s [ 951.360757] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.646314] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dd3699f9-0054-4c64-b6ca-b7703882a902',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.648431] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.747901] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.747901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.749446] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cacd06de-bf2f-4c72-8bfd-79ed0f33c39f with status ACTIVE [ 951.749446] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.749446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.749446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.749640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.749673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.749838] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.749931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.749989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.750146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.750218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.750387] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.750474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.750530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.750664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.750775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.750820] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cacd06de-bf2f-4c72-8bfd-79ed0f33c39f is going to be updated. [ 951.751987] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3699f9-0054-4c64-b6ca-b7703882a902 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.752720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.780267] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.780411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.780450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.780683] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.780774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.780938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.863816] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.150288] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dd3699f9-0054-4c64-b6ca-b7703882a902',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.151231] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.195699] env[67003]: INFO networking_nsxv3.common.synchronization [req-d356d8fc-5d07-445d-be79-281db8884198 req-a7c7fdc4-ef6d-438b-90cc-6d0c9ca47f4d tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: dd3699f9-0054-4c64-b6ca-b7703882a902 with Priority: HIGHEST for action security_group_members [ 952.196496] env[67003]: INFO networking_nsxv3.common.synchronization [req-d356d8fc-5d07-445d-be79-281db8884198 req-a7c7fdc4-ef6d-438b-90cc-6d0c9ca47f4d tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 952.196902] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd3699f9-0054-4c64-b6ca-b7703882a902 with Priority: HIGHEST for action security_group_members [ 952.197356] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 952.197661] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dd3699f9-0054-4c64-b6ca-b7703882a902 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.197750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.198302] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.198302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.247477] env[67003]: INFO networking_nsxv3.common.synchronization [req-d356d8fc-5d07-445d-be79-281db8884198 req-a7c7fdc4-ef6d-438b-90cc-6d0c9ca47f4d tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_rules [ 952.248085] env[67003]: INFO networking_nsxv3.common.synchronization [req-d356d8fc-5d07-445d-be79-281db8884198 req-a7c7fdc4-ef6d-438b-90cc-6d0c9ca47f4d tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 952.248398] env[67003]: INFO networking_nsxv3.common.synchronization [req-d356d8fc-5d07-445d-be79-281db8884198 req-a7c7fdc4-ef6d-438b-90cc-6d0c9ca47f4d tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: cacd06de-bf2f-4c72-8bfd-79ed0f33c39f with Priority: HIGHEST for action port [ 952.249236] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_rules [ 952.249734] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 952.249871] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cacd06de-bf2f-4c72-8bfd-79ed0f33c39f with Priority: HIGHEST for action port [ 952.250191] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.250378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.250498] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.250581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.250757] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.250863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.250935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.251145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.251225] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cacd06de-bf2f-4c72-8bfd-79ed0f33c39f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.367925] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.367925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.367925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.367925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.367925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.367925] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 952.404125] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.404125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.404125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.405328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.405328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.414567] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 952.652988] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.653221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.653280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.653450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.653538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.653643] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd3699f9-0054-4c64-b6ca-b7703882a902 is going to be created. [ 952.655121] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.655266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.655364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.655511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.655595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.655687] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 is going to be updated. [ 952.679902] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.680089] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.680143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.680386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.680591] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.683267] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.683396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.683466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.684371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.684371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.693859] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: IN_PROGRESS for 2s [ 952.694618] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd3699f9-0054-4c64-b6ca-b7703882a902 in Status: UNINITIALIZED for 2s [ 952.755958] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cacd06de-bf2f-4c72-8bfd-79ed0f33c39f with status ACTIVE [ 952.756457] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.756737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.756881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.757275] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.757421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.757658] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.757830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.757909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.758213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.758378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.758685] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.758905] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.759038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.759241] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.759357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.759499] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cacd06de-bf2f-4c72-8bfd-79ed0f33c39f is going to be updated. [ 952.792661] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.792661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.792661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.792921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.792953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.793824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cacd06de-bf2f-4c72-8bfd-79ed0f33c39f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.876067] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: SUCCESS [ 952.876937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.876937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.876937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.877336] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.877433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.877503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.877673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.877756] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.877858] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.879594] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 952.879852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.880098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.880372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.880693] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.880836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.880945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.881198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.882035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.882035] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.330921] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 in Status: SUCCESS [ 953.331168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.385241] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.385241] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.886803] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.888690] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.390744] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.391263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.391263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.391263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.391364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.391433] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 954.392806] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.392979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.392979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.393159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.393241] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.393330] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4863374-5c9e-490a-be11-1eac203337f7 is going to be updated. [ 954.428826] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 954.429057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.429638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.429967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.430257] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.430385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.430453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.430624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.430707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.430807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.430886] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.432798] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.432956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.433067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.433353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.433543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.435714] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.435959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.435959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.436145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.436329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.445817] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: IN_PROGRESS for 2s [ 954.446808] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 954.571057] env[67003]: INFO networking_nsxv3.common.synchronization [None req-d43261f7-c1e5-4424-807e-35ee0b5aecb8 None None] Enqueued Resource ID: 0b732885-d616-4a9f-82c1-db44123321bc with Priority: HIGHEST for action port [ 954.571225] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b732885-d616-4a9f-82c1-db44123321bc with Priority: HIGHEST for action port [ 954.571803] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b732885-d616-4a9f-82c1-db44123321bc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.571933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b732885-d616-4a9f-82c1-db44123321bc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.571999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b732885-d616-4a9f-82c1-db44123321bc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.575898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b732885-d616-4a9f-82c1-db44123321bc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.575898] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b732885-d616-4a9f-82c1-db44123321bc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.711033] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dd3699f9-0054-4c64-b6ca-b7703882a902 in Status: SUCCESS [ 954.711033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.711033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.711033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.711033] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.711033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.711033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.711033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.711033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.711033] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd3699f9-0054-4c64-b6ca-b7703882a902',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.714300] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: SUCCESS [ 954.715218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.715636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.716228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.717376] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.719032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.719032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.719032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.719032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.719032] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.938539] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.938705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.938751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.939153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.939244] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.939643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.939733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.939928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.940052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.940172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.940376] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.940521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.940736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.940946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.941212] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.941305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.941438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.941612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.941697] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.941780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.941872] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.077231] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b732885-d616-4a9f-82c1-db44123321bc [ 955.077505] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.077640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.077701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.077987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.078282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.078416] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b732885-d616-4a9f-82c1-db44123321bc already deleted. [ 955.078529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b732885-d616-4a9f-82c1-db44123321bc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.222634] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.222634] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.222634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.222634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.222634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.222634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.222958] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.222958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.222958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.223121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.223121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.223266] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd3699f9-0054-4c64-b6ca-b7703882a902 is going to be deleted. [ 955.264216] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.267255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.267255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.267255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.267255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.267255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.267255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.267255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.267255] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.267255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.267255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.267255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.267255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.267255] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd3699f9-0054-4c64-b6ca-b7703882a902',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.444697] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c06f8726-ef82-4058-ad8d-7e0aabd079e1: rpc.has_security_group_logging(os_id): False [ 955.471237] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.471237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.471237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.471237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.471237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.471237] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.471237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.471237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.471237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.471237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.471237] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.471237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.471237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.471237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.471237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.471837] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.471837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.471837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.472359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.474190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.474190] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 955.541912] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.542334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.542509] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.544027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.544027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.560874] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 955.728389] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.770036] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.771318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.771318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.773172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.774235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.774235] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.774235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.774235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.774235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.774235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.774235] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd3699f9-0054-4c64-b6ca-b7703882a902 already deleted. [ 955.774567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.774567] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dd3699f9-0054-4c64-b6ca-b7703882a902',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.776280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.777041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.777041] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.777207] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.777207] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.777456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.777574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.777679] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dd3699f9-0054-4c64-b6ca-b7703882a902',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.231885] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.232339] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.232339] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.232538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.233569] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.233745] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 is going to be updated. [ 956.273024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.273024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.273024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.273024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.273024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.281185] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dd3699f9-0054-4c64-b6ca-b7703882a902',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.281496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.282723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.282723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.282723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.282723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.282723] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.282723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.282723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.282723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.282723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.282723] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dd3699f9-0054-4c64-b6ca-b7703882a902 already deleted. [ 956.283148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.285105] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: IN_PROGRESS for 2s [ 956.461775] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: SUCCESS [ 956.462166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.462423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.462486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.462687] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.462937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.462937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.463143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.463215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.463300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.463368] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.465190] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 956.465419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.465588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.466034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.466118] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.466229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.466229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.466417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.466495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.466580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.466670] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.785814] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dd3699f9-0054-4c64-b6ca-b7703882a902: rpc.has_security_group_logging(os_id): False [ 956.815070] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.815684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.815684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.815981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.816369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.817147] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.817510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.817586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.817929] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.818153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.818279] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd3699f9-0054-4c64-b6ca-b7703882a902 is going to be created. [ 956.841753] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/dd3699f9-0054-4c64-b6ca-b7703882a902], does not exist path=[/infra/domains/default/groups/dd3699f9-0054-4c64-b6ca-b7703882a902]."\n}' [ 956.841939] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd3699f9-0054-4c64-b6ca-b7703882a902 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/dd3699f9-0054-4c64-b6ca-b7703882a902 [ 956.842034] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 956.887421] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.888174] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.888356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.888751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.891777] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.892458] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.892745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.892927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.893308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.893534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.893979] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.894246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.894399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.894749] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.894963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.895207] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dd3699f9-0054-4c64-b6ca-b7703882a902 is going to be created. [ 956.921650] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/dd3699f9-0054-4c64-b6ca-b7703882a902], does not exist path=[/infra/domains/default/groups/dd3699f9-0054-4c64-b6ca-b7703882a902]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/dd3699f9-0054-4c64-b6ca-b7703882a902 [ 956.922067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dd3699f9-0054-4c64-b6ca-b7703882a902" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.922855] env[67003]: Traceback (most recent call last): [ 956.922917] env[67003]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 956.922917] env[67003]: return func(*args, **kwargs) [ 956.922917] env[67003]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 956.922917] env[67003]: res.raise_for_status() [ 956.922917] env[67003]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 956.922917] env[67003]: raise HTTPError(http_error_msg, response=self) [ 956.922917] env[67003]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/dd3699f9-0054-4c64-b6ca-b7703882a902 [ 956.922917] env[67003]: During handling of the above exception, another exception occurred: [ 956.922917] env[67003]: Traceback (most recent call last): [ 956.922917] env[67003]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 956.922917] env[67003]: listener.cb(fileno) [ 956.922917] env[67003]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 956.922917] env[67003]: result = function(*args, **kwargs) [ 956.922917] env[67003]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 956.922917] env[67003]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 956.922917] env[67003]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 956.922917] env[67003]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 956.922917] env[67003]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 956.922917] env[67003]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 956.922917] env[67003]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 956.922917] env[67003]: res.raise_for_status() [ 956.922917] env[67003]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 956.922917] env[67003]: raise HTTPError(http_error_msg, response=self) [ 956.922917] env[67003]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/dd3699f9-0054-4c64-b6ca-b7703882a902 [ 956.922917] env[67003]: Removing descriptor: 66 [ 956.968530] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.969642] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.969793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.969858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.970093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.970255] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.970354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.970417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.970564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.970646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.970727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.970875] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.970966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.971037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.971181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.971313] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.971401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.971459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.971593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.971667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.971748] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.971849] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.474776] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4863374-5c9e-490a-be11-1eac203337f7: rpc.has_security_group_logging(os_id): False [ 957.476648] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc04636e-53f4-4929-8ae4-d13a910a1d84: rpc.has_security_group_logging(os_id): False [ 957.496988] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.499202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.499327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.499716] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.499716] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.499976] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.500132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.500200] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.500377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.500459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.500552] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4863374-5c9e-490a-be11-1eac203337f7 is going to be created. [ 957.502885] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.503022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.503102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.503248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.529285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.530423] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.530423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.530423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.530423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.530423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.530423] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.530423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.530423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.530423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.530423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.530883] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.530883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.530883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.530883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.531044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.531044] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 957.569306] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.569510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.569552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.570557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.570557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.575262] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 957.575507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.582146] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: IN_PROGRESS for 2s [ 957.616775] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.617012] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.617012] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.617260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.617408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.646840] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 958.297326] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: SUCCESS [ 958.297532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.297699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.297921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.298131] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.298245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.298308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.298619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.298619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.298619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.298759] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.299586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.299712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.299869] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.299977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.300053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.300194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.300269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.300355] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.359246] env[67003]: INFO networking_nsxv3.common.synchronization [None req-f095ed4e-c07d-4f20-8bd4-50df6be7abb5 None None] Enqueued Resource ID: 8593b199-6f91-4afe-8e51-9cd9ee5e6cc0 with Priority: HIGHEST for action port [ 958.359768] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8593b199-6f91-4afe-8e51-9cd9ee5e6cc0 with Priority: HIGHEST for action port [ 958.360121] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-8593b199-6f91-4afe-8e51-9cd9ee5e6cc0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.360212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8593b199-6f91-4afe-8e51-9cd9ee5e6cc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.360337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8593b199-6f91-4afe-8e51-9cd9ee5e6cc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.360523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8593b199-6f91-4afe-8e51-9cd9ee5e6cc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.360611] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8593b199-6f91-4afe-8e51-9cd9ee5e6cc0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.802439] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.802838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.802838] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.863361] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8593b199-6f91-4afe-8e51-9cd9ee5e6cc0 [ 958.864134] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.864134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.864134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.864134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.864134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.864592] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8593b199-6f91-4afe-8e51-9cd9ee5e6cc0 already deleted. [ 958.864592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8593b199-6f91-4afe-8e51-9cd9ee5e6cc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.306022] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.595551] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: SUCCESS [ 959.595551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.669342] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 959.670302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.803870] env[67003]: INFO networking_nsxv3.common.synchronization [None req-96bcc74f-a522-45bd-9cb8-421fc6871c7b None None] Enqueued Resource ID: 9bc497b4-4e35-43ae-9cf7-fc6a6a8c2c6e with Priority: HIGHEST for action port [ 959.803870] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9bc497b4-4e35-43ae-9cf7-fc6a6a8c2c6e with Priority: HIGHEST for action port [ 959.804301] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-9bc497b4-4e35-43ae-9cf7-fc6a6a8c2c6e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.805035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9bc497b4-4e35-43ae-9cf7-fc6a6a8c2c6e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.805035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9bc497b4-4e35-43ae-9cf7-fc6a6a8c2c6e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.805172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9bc497b4-4e35-43ae-9cf7-fc6a6a8c2c6e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.805302] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9bc497b4-4e35-43ae-9cf7-fc6a6a8c2c6e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.809564] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.809802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.809885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.810154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.810335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.810455] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 is going to be updated. [ 959.851993] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.852575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.852695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.852942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.853119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.873020] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: IN_PROGRESS for 2s [ 960.277491] env[67003]: INFO networking_nsxv3.common.synchronization [None req-9a695c36-2c28-48f2-93bb-ad1a2b05c39b tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGHEST for action security_group_rules [ 960.277491] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGHEST for action security_group_rules [ 960.277491] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55815927-bbca-4dbc-be18-77001e3e9c6b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.277491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.277491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.277779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.277779] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55815927-bbca-4dbc-be18-77001e3e9c6b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.309140] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9bc497b4-4e35-43ae-9cf7-fc6a6a8c2c6e [ 960.309140] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.309140] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.309140] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.309140] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.309140] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.309140] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9bc497b4-4e35-43ae-9cf7-fc6a6a8c2c6e already deleted. [ 960.309140] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9bc497b4-4e35-43ae-9cf7-fc6a6a8c2c6e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.515166] env[67003]: INFO networking_nsxv3.common.synchronization [None req-f9b476ca-d071-4651-8cac-a0cc96c12c60 tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGHEST for action security_group_rules [ 960.515835] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGHEST for action security_group_rules [ 960.517116] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55815927-bbca-4dbc-be18-77001e3e9c6b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.517116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.808674] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.808674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.808674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.809030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.812717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.812717] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55815927-bbca-4dbc-be18-77001e3e9c6b already deleted. [ 960.812717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.812717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.812717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.812717] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55815927-bbca-4dbc-be18-77001e3e9c6b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.339646] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.339832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.339926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.340259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.340366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.340499] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55815927-bbca-4dbc-be18-77001e3e9c6b already deleted. [ 961.340815] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.743076] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ae54701-c37e-4a38-9beb-b1d93953dfda req-1461b32f-c4f8-40e1-9361-f4601a1d8538 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_members [ 961.743285] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ae54701-c37e-4a38-9beb-b1d93953dfda req-1461b32f-c4f8-40e1-9361-f4601a1d8538 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 961.743515] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ae54701-c37e-4a38-9beb-b1d93953dfda req-1461b32f-c4f8-40e1-9361-f4601a1d8538 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dba32874-38b5-4411-a3c9-effdd63d65c0 with Priority: HIGHEST for action security_group_members [ 961.744327] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_members [ 961.744490] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 961.744668] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba32874-38b5-4411-a3c9-effdd63d65c0 with Priority: HIGHEST for action security_group_members [ 961.745125] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4863374-5c9e-490a-be11-1eac203337f7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.745418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.745418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.745723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.745995] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.746150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.746220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.746403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.746490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.746588] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.747577] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.747685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.747739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.747906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.748211] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.748361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.748436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.748636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.748757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.748890] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.750033] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba32874-38b5-4411-a3c9-effdd63d65c0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.750193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.750293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.750593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.750822] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.751308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.751308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.751308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.751488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.751518] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dba32874-38b5-4411-a3c9-effdd63d65c0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.801018] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ae54701-c37e-4a38-9beb-b1d93953dfda req-1461b32f-c4f8-40e1-9361-f4601a1d8538 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_rules [ 961.801018] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ae54701-c37e-4a38-9beb-b1d93953dfda req-1461b32f-c4f8-40e1-9361-f4601a1d8538 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_members [ 961.801018] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ae54701-c37e-4a38-9beb-b1d93953dfda req-1461b32f-c4f8-40e1-9361-f4601a1d8538 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dba32874-38b5-4411-a3c9-effdd63d65c0 with Priority: HIGHEST for action security_group_rules [ 961.801018] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ae54701-c37e-4a38-9beb-b1d93953dfda req-1461b32f-c4f8-40e1-9361-f4601a1d8538 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dba32874-38b5-4411-a3c9-effdd63d65c0 with Priority: HIGHEST for action security_group_members [ 961.801227] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ae54701-c37e-4a38-9beb-b1d93953dfda req-1461b32f-c4f8-40e1-9361-f4601a1d8538 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_rules [ 961.801298] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ae54701-c37e-4a38-9beb-b1d93953dfda req-1461b32f-c4f8-40e1-9361-f4601a1d8538 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 961.801390] env[67003]: INFO networking_nsxv3.common.synchronization [req-4ae54701-c37e-4a38-9beb-b1d93953dfda req-1461b32f-c4f8-40e1-9361-f4601a1d8538 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: 0c2632e2-355c-49f4-8c25-95bc7e9df6cc with Priority: HIGHEST for action port [ 961.802129] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_rules [ 961.802201] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba32874-38b5-4411-a3c9-effdd63d65c0 with Priority: HIGHEST for action security_group_rules [ 961.802251] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 961.802350] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c2632e2-355c-49f4-8c25-95bc7e9df6cc with Priority: HIGHEST for action port [ 961.802441] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_rules [ 961.802539] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_members [ 961.802869] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba32874-38b5-4411-a3c9-effdd63d65c0 with Priority: HIGHEST for action security_group_members [ 961.803578] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4863374-5c9e-490a-be11-1eac203337f7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.803578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.803578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.803578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.803967] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.804581] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dba32874-38b5-4411-a3c9-effdd63d65c0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.804791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.804791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.805161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.805161] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dba32874-38b5-4411-a3c9-effdd63d65c0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.805980] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.806130] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.806303] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.806418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.806488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.806689] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.806765] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0c2632e2-355c-49f4-8c25-95bc7e9df6cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.807550] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.807663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.807729] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.808100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.808100] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.811196] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4863374-5c9e-490a-be11-1eac203337f7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.811500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.811625] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba32874-38b5-4411-a3c9-effdd63d65c0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.811718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.884679] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: SUCCESS [ 961.885622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.885622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.885912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.886142] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.886347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.886347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.887030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.887030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.887030] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.159413] env[67003]: INFO networking_nsxv3.common.synchronization [req-a38ac8f5-1974-4db4-8e93-58ababeaaa63 req-afa0da83-86e4-43bb-b9b2-065e2613324e tempest-SecurityGroupRulesNegativeTestJSON-1798042994 tempest-SecurityGroupRulesNegativeTestJSON-1798042994-project-member] Enqueued Resource ID: cf303510-0f63-42e2-9ea1-ad0ee67c1067 with Priority: HIGHEST for action security_group_rules [ 962.159413] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf303510-0f63-42e2-9ea1-ad0ee67c1067 with Priority: HIGHEST for action security_group_rules [ 962.159413] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf303510-0f63-42e2-9ea1-ad0ee67c1067 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.159413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf303510-0f63-42e2-9ea1-ad0ee67c1067" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.159413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf303510-0f63-42e2-9ea1-ad0ee67c1067" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.159666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf303510-0f63-42e2-9ea1-ad0ee67c1067" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.159743] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf303510-0f63-42e2-9ea1-ad0ee67c1067',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.260679] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.260679] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.262394] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dba32874-38b5-4411-a3c9-effdd63d65c0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.316038] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0c2632e2-355c-49f4-8c25-95bc7e9df6cc with status ACTIVE [ 962.316038] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.316038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.316038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.316038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.316038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.316038] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.316038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.316038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.316038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.316038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.316038] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.316038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.316038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.316038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.316038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.316038] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0c2632e2-355c-49f4-8c25-95bc7e9df6cc is going to be updated. [ 962.317501] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4863374-5c9e-490a-be11-1eac203337f7 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.317745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.318082] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba32874-38b5-4411-a3c9-effdd63d65c0 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.318406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.318744] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.319083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.339983] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.339983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.339983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.340146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.340318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.340860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0c2632e2-355c-49f4-8c25-95bc7e9df6cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.390102] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.682028] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.682256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.682256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.682898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.682898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.682898] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf303510-0f63-42e2-9ea1-ad0ee67c1067 already deleted. [ 962.682898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf303510-0f63-42e2-9ea1-ad0ee67c1067" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.763689] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.765526] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dba32874-38b5-4411-a3c9-effdd63d65c0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.767090] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.893692] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.230926] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ab7ce258-f3df-4545-9082-920f96f72f8a None None] Enqueued Resource ID: c639c127-8dcd-4c36-b256-f1933b14fc63 with Priority: HIGHEST for action port [ 963.231420] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c639c127-8dcd-4c36-b256-f1933b14fc63 with Priority: HIGHEST for action port [ 963.234190] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-c639c127-8dcd-4c36-b256-f1933b14fc63 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.234400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c639c127-8dcd-4c36-b256-f1933b14fc63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.234522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c639c127-8dcd-4c36-b256-f1933b14fc63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.236307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c639c127-8dcd-4c36-b256-f1933b14fc63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.236307] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c639c127-8dcd-4c36-b256-f1933b14fc63',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.269280] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.269385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.269474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.269707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.269829] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.269958] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dba32874-38b5-4411-a3c9-effdd63d65c0 is going to be created. [ 963.271421] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.271551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.271621] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.271801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.271912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.272030] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 963.273464] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.273586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.273664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.273898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.273977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.274076] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4863374-5c9e-490a-be11-1eac203337f7 is going to be updated. [ 963.315371] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.315371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.315371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.315371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.315371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.317593] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.317790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.317909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.318408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.319038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.321958] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.322090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.322235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.322513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.322691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.339496] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 963.339496] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: IN_PROGRESS for 2s [ 963.339906] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba32874-38b5-4411-a3c9-effdd63d65c0 in Status: UNINITIALIZED for 2s [ 963.396625] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.396824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.396964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.397228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.397366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.397475] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 is going to be updated. [ 963.446249] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.446415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.446483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.446744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.446943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.461077] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: IN_PROGRESS for 2s [ 963.601665] env[67003]: INFO networking_nsxv3.common.synchronization [req-f6eea9c8-e350-472d-b239-9b90f5033d3c req-040136a2-4665-491c-ae9b-7e42dcb728ae tempest-DeleteServersTestJSON-1342989894 tempest-DeleteServersTestJSON-1342989894-project-member] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 963.602277] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 963.602592] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.602715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.602784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.602973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.603146] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.603247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.603315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.603463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.603548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.603644] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.739129] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c639c127-8dcd-4c36-b256-f1933b14fc63 [ 963.739382] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.739608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.739706] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.740059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.740191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.740312] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c639c127-8dcd-4c36-b256-f1933b14fc63 already deleted. [ 963.740424] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c639c127-8dcd-4c36-b256-f1933b14fc63" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.093301] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-521 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.093655] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.093655] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.093902] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.094570] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.094744] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.094868] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.095208] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.095343] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.095561] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.095697] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 964.095900] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 964.096049] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 964.096170] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 964.096278] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 964.096418] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 964.106384] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.106529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.106627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.106813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.110640] env[67003]: INFO networking_nsxv3.common.synchronization [None req-8654abbc-2e76-47ac-aa44-37ad7dd082dd tempest-ServerDiskConfigTestJSON-448903628 tempest-ServerDiskConfigTestJSON-448903628-project-member] Enqueued Resource ID: 270c19bc-3f2f-4cfd-ac32-34b9a198c66b with Priority: HIGHEST for action security_group_rules [ 964.111549] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 270c19bc-3f2f-4cfd-ac32-34b9a198c66b with Priority: HIGHEST for action security_group_rules [ 964.111861] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-270c19bc-3f2f-4cfd-ac32-34b9a198c66b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.111969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-270c19bc-3f2f-4cfd-ac32-34b9a198c66b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.112068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-270c19bc-3f2f-4cfd-ac32-34b9a198c66b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.112311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-270c19bc-3f2f-4cfd-ac32-34b9a198c66b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.112396] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('270c19bc-3f2f-4cfd-ac32-34b9a198c66b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.126167] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 964.126348] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 964.126566] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 964.126763] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.127169] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-1a613fc9-f5b4-44f4-be7e-e48dabc25bc1 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.127348] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-1a613fc9-f5b4-44f4-be7e-e48dabc25bc1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.127471] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-1a613fc9-f5b4-44f4-be7e-e48dabc25bc1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.127785] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-1a613fc9-f5b4-44f4-be7e-e48dabc25bc1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.127926] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a613fc9-f5b4-44f4-be7e-e48dabc25bc1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.133132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.133375] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.133494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.133558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.133751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.133862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.133955] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 964.164794] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.165541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.166302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.167495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.167495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.186348] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 964.238739] env[67003]: INFO networking_nsxv3.common.synchronization [None req-af4d2f32-faba-44e1-ac7e-26546383a9df tempest-ServerDiskConfigTestJSON-448903628 tempest-ServerDiskConfigTestJSON-448903628-project-member] Enqueued Resource ID: 270c19bc-3f2f-4cfd-ac32-34b9a198c66b with Priority: HIGHEST for action security_group_rules [ 964.239334] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 270c19bc-3f2f-4cfd-ac32-34b9a198c66b with Priority: HIGHEST for action security_group_rules [ 964.239644] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-270c19bc-3f2f-4cfd-ac32-34b9a198c66b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.239746] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-270c19bc-3f2f-4cfd-ac32-34b9a198c66b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.698439] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.698439] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.698439] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.698439] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.698439] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.698439] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 1a613fc9-f5b4-44f4-be7e-e48dabc25bc1 not found, creating... [ 964.698439] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.698439] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.698439] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.698439] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.698439] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.702465] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.702465] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.702465] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.702465] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.702465] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.702465] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 1a613fc9-f5b4-44f4-be7e-e48dabc25bc1 is going to be created. [ 964.702465] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.702465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.702465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.702465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.702465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.702465] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 270c19bc-3f2f-4cfd-ac32-34b9a198c66b already deleted. [ 964.702465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-270c19bc-3f2f-4cfd-ac32-34b9a198c66b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.702465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-270c19bc-3f2f-4cfd-ac32-34b9a198c66b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.703196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-270c19bc-3f2f-4cfd-ac32-34b9a198c66b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.703196] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('270c19bc-3f2f-4cfd-ac32-34b9a198c66b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.703196] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.703196] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.703196] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.703196] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.703196] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.703196] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-1a613fc9-f5b4-44f4-be7e-e48dabc25bc1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.183597] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.183597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.183597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.183597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.183597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.184158] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 270c19bc-3f2f-4cfd-ac32-34b9a198c66b already deleted. [ 965.184158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-270c19bc-3f2f-4cfd-ac32-34b9a198c66b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.211228] env[67003]: INFO networking_nsxv3.common.synchronization [req-078dd526-a545-4140-9385-eea3f28598d6 req-c0801351-c8a8-4ea8-a5bf-d71eaf6c9b73 tempest-SecurityGroupRulesNegativeTestJSON-1798042994 tempest-SecurityGroupRulesNegativeTestJSON-1798042994-project-member] Enqueued Resource ID: cf303510-0f63-42e2-9ea1-ad0ee67c1067 with Priority: HIGHEST for action security_group_rules [ 965.211791] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf303510-0f63-42e2-9ea1-ad0ee67c1067 with Priority: HIGHEST for action security_group_rules [ 965.212156] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cf303510-0f63-42e2-9ea1-ad0ee67c1067 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.212382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cf303510-0f63-42e2-9ea1-ad0ee67c1067" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.212382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cf303510-0f63-42e2-9ea1-ad0ee67c1067" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.212526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cf303510-0f63-42e2-9ea1-ad0ee67c1067" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.212604] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cf303510-0f63-42e2-9ea1-ad0ee67c1067',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.352266] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: SUCCESS [ 965.352432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.353189] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 965.353360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.353512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.353863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.354020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.354139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.354207] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.354378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.354455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.354552] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.355354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.355997] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.357122] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.357122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.357122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.357122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.357122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.357122] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.358624] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba32874-38b5-4411-a3c9-effdd63d65c0 in Status: SUCCESS [ 965.358698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.359914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.359914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.359914] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.359914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.359914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.361728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.362139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.362139] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dba32874-38b5-4411-a3c9-effdd63d65c0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.397859] env[67003]: INFO networking_nsxv3.common.synchronization [req-f6eea9c8-e350-472d-b239-9b90f5033d3c req-57830763-591b-4084-b02f-0761303895c5 service nova] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_rules [ 965.398184] env[67003]: INFO networking_nsxv3.common.synchronization [req-f6eea9c8-e350-472d-b239-9b90f5033d3c req-57830763-591b-4084-b02f-0761303895c5 service nova] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 965.398422] env[67003]: INFO networking_nsxv3.common.synchronization [req-f6eea9c8-e350-472d-b239-9b90f5033d3c req-57830763-591b-4084-b02f-0761303895c5 service nova] Enqueued Resource ID: 1a613fc9-f5b4-44f4-be7e-e48dabc25bc1 with Priority: HIGHEST for action port [ 965.400786] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_rules [ 965.400786] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 965.400786] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a613fc9-f5b4-44f4-be7e-e48dabc25bc1 with Priority: HIGHEST for action port [ 965.400880] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.400982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.401136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.401475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.403593] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.404997] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.404997] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.404997] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a613fc9-f5b4-44f4-be7e-e48dabc25bc1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.404997] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a613fc9-f5b4-44f4-be7e-e48dabc25bc1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.404997] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a613fc9-f5b4-44f4-be7e-e48dabc25bc1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.404997] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a613fc9-f5b4-44f4-be7e-e48dabc25bc1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.404997] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a613fc9-f5b4-44f4-be7e-e48dabc25bc1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.474024] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: SUCCESS [ 965.474024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.474024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.474219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.474450] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.474543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.474636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.474724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.474813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.474902] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.475064] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.475239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.475239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.475344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.476036] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.476036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.476036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.476036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.476036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.476036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.476036] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.738470] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.738680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.738784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.739041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.739231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.739281] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cf303510-0f63-42e2-9ea1-ad0ee67c1067 already deleted. [ 965.739370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cf303510-0f63-42e2-9ea1-ad0ee67c1067" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.858589] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.865309] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.865439] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dba32874-38b5-4411-a3c9-effdd63d65c0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.907067] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.907213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.907587] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1a613fc9-f5b4-44f4-be7e-e48dabc25bc1 with status ACTIVE [ 965.907587] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.907722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.907754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.907938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.908050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.908229] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.908332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.908392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.908549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.908627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.908893] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.909015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.909074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.909212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.910634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.910634] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1a613fc9-f5b4-44f4-be7e-e48dabc25bc1 is going to be updated. [ 965.936663] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.936863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.936933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.937743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.937743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.937743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a613fc9-f5b4-44f4-be7e-e48dabc25bc1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.979633] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ca7593b-6cf9-418e-9d37-bb09b986e001: rpc.has_security_group_logging(os_id): False [ 966.001150] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.001318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.001631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.001953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.025023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.026473] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.026473] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.026473] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.026666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.026935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.027131] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.027255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.027323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.027513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.027595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.027791] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.027891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.027955] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.028115] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.028190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.028276] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 is going to be updated. [ 966.127208] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.127531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.127681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.128169] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.128933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.143426] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: IN_PROGRESS for 2s [ 966.199544] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 966.199834] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 deletion is rescheduled due to dependency. [ 966.199834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.200119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.200227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.200447] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.200568] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.200941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.200941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.200941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.201060] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.362048] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.368203] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.369922] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dba32874-38b5-4411-a3c9-effdd63d65c0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.707232] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 966.865949] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.865949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.866143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.866277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.866401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.866515] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4863374-5c9e-490a-be11-1eac203337f7 is going to be updated. [ 966.871626] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.871783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.871871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.872069] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.872161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.872283] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 966.873524] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.873653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.873722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.873921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.874051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.874150] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dba32874-38b5-4411-a3c9-effdd63d65c0 is going to be updated. [ 966.904999] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.904999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.904999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.904999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.904999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.906198] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.906600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.906795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.907103] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.907327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.908976] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 966.909232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 966.909377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 966.909634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 966.909846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 966.923749] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: IN_PROGRESS for 2s [ 966.928335] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba32874-38b5-4411-a3c9-effdd63d65c0 in Status: IN_PROGRESS for 2s [ 966.928335] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 967.208769] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 967.715810] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.716072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.716149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.716372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.716466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.716563] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 967.789064] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.789229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.789292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.789490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.791023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.801015] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 968.162789] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: SUCCESS [ 968.162789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.162789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.163076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.163076] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.308050] env[67003]: INFO networking_nsxv3.common.synchronization [req-071ffeae-fa19-47da-b022-d048c337667f req-f79f41af-4701-49a5-8b84-66a7da1061bc tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGHEST for action security_group_members [ 968.309025] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGHEST for action security_group_members [ 968.309025] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55815927-bbca-4dbc-be18-77001e3e9c6b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.309025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.309222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.309504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.309504] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.309651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.309651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.309784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.309870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.309968] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55815927-bbca-4dbc-be18-77001e3e9c6b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.665954] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.666193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.666232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.666457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.666637] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.666757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.666821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.667081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.667177] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.667365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.667523] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.675691] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.675691] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.675691] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.675691] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.675691] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.675691] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.676172] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.676555] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.676768] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.677054] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.677189] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 968.677331] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 968.677464] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 968.677601] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 968.677746] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 968.677928] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 968.704028] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 968.704028] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 968.704028] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 968.704028] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.704028] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-522fcf37-6334-4b17-9024-fd6523391f7b taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.704028] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-522fcf37-6334-4b17-9024-fd6523391f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.704028] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-522fcf37-6334-4b17-9024-fd6523391f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.704028] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-522fcf37-6334-4b17-9024-fd6523391f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.704028] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('522fcf37-6334-4b17-9024-fd6523391f7b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.811888] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.812367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.812519] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.812649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.812793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.812959] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.813083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.813130] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.813341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.813341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.813443] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55815927-bbca-4dbc-be18-77001e3e9c6b already deleted. [ 968.813494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.938662] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: SUCCESS [ 968.938895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.939085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.939312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.939576] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.939703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.939784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.939947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.940051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.940139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.940230] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.941890] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba32874-38b5-4411-a3c9-effdd63d65c0 in Status: SUCCESS [ 968.942144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.942895] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 968.943113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.943632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.943872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.944690] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.944858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.944904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.945091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.945175] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.945270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.945502] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dba32874-38b5-4411-a3c9-effdd63d65c0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.946430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.946727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.946906] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.947497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.947497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.947497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.949011] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.949179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.949306] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.170704] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.170955] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.171072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.171301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.171518] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.171652] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.171748] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.171956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.172086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.172181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.172358] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.172459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.172558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.172745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.173562] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.173562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.173562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.173562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.173562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.173885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.173885] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.206382] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.206695] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.206880] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.207243] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.207452] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.207671] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 522fcf37-6334-4b17-9024-fd6523391f7b not found, creating... [ 969.207980] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.208181] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.208332] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.208634] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.208842] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.209248] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.209514] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.209620] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.209893] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.210086] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.210286] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 522fcf37-6334-4b17-9024-fd6523391f7b is going to be created. [ 969.232502] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.232909] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.233203] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.233622] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.233929] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.234187] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-522fcf37-6334-4b17-9024-fd6523391f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.450913] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.451888] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dba32874-38b5-4411-a3c9-effdd63d65c0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.452854] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.454973] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.454973] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.454973] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.454973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.456461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.456461] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.677062] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ca7593b-6cf9-418e-9d37-bb09b986e001: rpc.has_security_group_logging(os_id): False [ 969.699330] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.699494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.699536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.699771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.700492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.700492] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.700492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.700492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.700492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.700492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.700837] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.700837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.700837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.701043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.701043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.701189] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.702569] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.702569] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.702569] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.702569] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.702569] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 is going to be updated. [ 969.770375] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.770375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.770375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.770375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.770375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.785748] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: IN_PROGRESS for 2s [ 969.820088] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 969.820088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.820088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.820088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.820088] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.820088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.820088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.820088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.820088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.820088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.820088] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.955288] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a4863374-5c9e-490a-be11-1eac203337f7: rpc.has_security_group_logging(os_id): False [ 969.957628] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dba32874-38b5-4411-a3c9-effdd63d65c0: rpc.has_security_group_logging(os_id): False [ 969.957791] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc04636e-53f4-4929-8ae4-d13a910a1d84: rpc.has_security_group_logging(os_id): False [ 969.975978] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.976145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.976220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.976449] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.976547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.976754] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.976855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.976935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.977135] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.977231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.977326] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dba32874-38b5-4411-a3c9-effdd63d65c0 is going to be created. [ 969.979936] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.979936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.979936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.979936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.979936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.980183] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.980352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.980352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.980567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.980663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.980762] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4863374-5c9e-490a-be11-1eac203337f7 is going to be updated. [ 969.982500] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.982611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.982680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.982862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.983382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.983382] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.983382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.983382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.983550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.983550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.983704] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.983835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.983949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.984063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.984142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.984341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.984436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.984495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.984654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.984733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.984857] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 969.997112] env[67003]: INFO networking_nsxv3.common.synchronization [req-071ffeae-fa19-47da-b022-d048c337667f req-7b2c3856-03cf-45e0-a0b4-c84c3f180407 service nova] Enqueued Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGHEST for action security_group_rules [ 969.997464] env[67003]: INFO networking_nsxv3.common.synchronization [req-071ffeae-fa19-47da-b022-d048c337667f req-7b2c3856-03cf-45e0-a0b4-c84c3f180407 service nova] Enqueued Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGHEST for action security_group_members [ 969.997714] env[67003]: INFO networking_nsxv3.common.synchronization [req-071ffeae-fa19-47da-b022-d048c337667f req-7b2c3856-03cf-45e0-a0b4-c84c3f180407 service nova] Enqueued Resource ID: 522fcf37-6334-4b17-9024-fd6523391f7b with Priority: HIGHEST for action port [ 969.998308] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGHEST for action security_group_rules [ 969.998475] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGHEST for action security_group_members [ 969.998584] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 522fcf37-6334-4b17-9024-fd6523391f7b with Priority: HIGHEST for action port [ 969.998862] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55815927-bbca-4dbc-be18-77001e3e9c6b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.998982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.999060] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.999277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.999364] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55815927-bbca-4dbc-be18-77001e3e9c6b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.001935] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55815927-bbca-4dbc-be18-77001e3e9c6b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.002197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.002280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.002542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.002716] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.002833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.002873] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.003029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.003115] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.003206] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55815927-bbca-4dbc-be18-77001e3e9c6b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.004117] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-522fcf37-6334-4b17-9024-fd6523391f7b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.004265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-522fcf37-6334-4b17-9024-fd6523391f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.004314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-522fcf37-6334-4b17-9024-fd6523391f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.004445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-522fcf37-6334-4b17-9024-fd6523391f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.004523] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('522fcf37-6334-4b17-9024-fd6523391f7b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.048470] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.048912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.048912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.049095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.049230] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.054481] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.054628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.054628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.057549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.057549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.057549] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.057549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.057549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.057549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.057549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.072169] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dba32874-38b5-4411-a3c9-effdd63d65c0 in Status: IN_PROGRESS for 2s [ 970.077661] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: IN_PROGRESS for 2s [ 970.095073] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 970.325207] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.325207] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.325207] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.325207] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.325207] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.325207] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.325207] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.325722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.325722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.325722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.325722] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.325722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.325940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.326061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.326210] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.326300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.326358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.326497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.326565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.326646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.326740] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.430226] env[67003]: INFO networking_nsxv3.common.synchronization [req-c07f263a-cca3-4a49-b478-3e8aad7a9ca9 req-07354d9c-2c9e-48a4-ae77-cbc52ba40c7b tempest-ImagesTestJSON-830230457 tempest-ImagesTestJSON-830230457-project-member] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 970.430816] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 970.431172] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.432297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.432297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.432297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.432297] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.432297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.432297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.432297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.432297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.432680] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.487518] env[67003]: INFO networking_nsxv3.common.synchronization [req-ecdb9835-7280-4e7e-a5e7-e41c6318e9c6 req-bf6954c6-d831-4428-889e-52478c6a7ce2 tempest-MigrationsAdminTest-779889772 tempest-MigrationsAdminTest-779889772-project-member] Enqueued Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_members [ 970.488352] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_members [ 970.488710] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.488838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.488926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.489141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.489382] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.489547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.489654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.490136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.490136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.490279] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.506027] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55815927-bbca-4dbc-be18-77001e3e9c6b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.506188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.506731] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55815927-bbca-4dbc-be18-77001e3e9c6b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.508932] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 522fcf37-6334-4b17-9024-fd6523391f7b with status ACTIVE [ 970.509346] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.509406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.510637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.510637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.510637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.511469] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.511616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.511737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.513879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.513879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.513879] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.513879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.513879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.513879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.513879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.513879] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 522fcf37-6334-4b17-9024-fd6523391f7b is going to be updated. [ 970.542125] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.542332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.542332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.542606] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.542733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.542997] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-522fcf37-6334-4b17-9024-fd6523391f7b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.675590] env[67003]: INFO networking_nsxv3.common.synchronization [req-5011501e-5b94-405a-9b6b-6283db7d07fd req-45bc7adf-3d40-4f83-97be-38d766473f7e tempest-ServerRescueTestJSONUnderV235-706647500 tempest-ServerRescueTestJSONUnderV235-706647500-project-member] Enqueued Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 970.676645] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGHEST for action security_group_members [ 970.677238] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.677373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.677450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.677710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.677962] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.678274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.678274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.678390] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.678437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.678576] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.703188] env[67003]: INFO networking_nsxv3.common.synchronization [req-21f14c51-f773-4f7c-91d5-aad00ced7ec0 req-845b0e79-a6d1-4483-ad7a-edd00ae68640 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_members [ 970.703523] env[67003]: INFO networking_nsxv3.common.synchronization [req-21f14c51-f773-4f7c-91d5-aad00ced7ec0 req-845b0e79-a6d1-4483-ad7a-edd00ae68640 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 970.703656] env[67003]: INFO networking_nsxv3.common.synchronization [req-21f14c51-f773-4f7c-91d5-aad00ced7ec0 req-845b0e79-a6d1-4483-ad7a-edd00ae68640 tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dba32874-38b5-4411-a3c9-effdd63d65c0 with Priority: HIGHEST for action security_group_members [ 970.704952] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGHEST for action security_group_members [ 970.705295] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 970.705408] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba32874-38b5-4411-a3c9-effdd63d65c0 with Priority: HIGHEST for action security_group_members [ 970.705708] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a4863374-5c9e-490a-be11-1eac203337f7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.705836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.705958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.706240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.706412] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.706524] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.706587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.706742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.706832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.706945] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.708580] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.708723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.708790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.708998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.709365] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.709482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.709549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.709791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.709919] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.709999] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.711104] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dba32874-38b5-4411-a3c9-effdd63d65c0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.711104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.711274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.711316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.712231] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.712231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.712231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.712396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.712396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.713493] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dba32874-38b5-4411-a3c9-effdd63d65c0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.829644] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06d182ef-21b7-44fd-8cbf-2f35f7927435: rpc.has_security_group_logging(os_id): False [ 970.853030] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.853030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.853030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.853030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.853030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.853030] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.853030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.853030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.853030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.853030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.853030] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.853030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.853030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.853030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.853941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.854365] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.857512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.857512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.857512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.857512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.857512] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 970.933724] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.935462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.935462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.935462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.935462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.936488] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.950507] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 970.993360] env[67003]: INFO networking_nsxv3.common.synchronization [req-3fa8e4c9-5702-4c3a-8bd3-22536ae0a086 req-7b13441a-f3cd-4264-b2d7-c9159513818f tempest-ServerDiskConfigTestJSON-448903628 tempest-ServerDiskConfigTestJSON-448903628-project-member] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 970.993691] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.995525] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 970.995525] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.995525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.995525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.995756] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.996476] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.999248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.999248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.999248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.999248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.999248] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.019539] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55815927-bbca-4dbc-be18-77001e3e9c6b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.182019] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.182237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.182309] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.182490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.182552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.182743] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.182853] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.182909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.183061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.183135] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.183226] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 is going to be updated. [ 971.209646] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.209816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.212086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.212086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.212086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.212086] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.212086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.212086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.212086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.212086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.212086] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4863374-5c9e-490a-be11-1eac203337f7 is going to be updated. [ 971.214202] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.215989] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.215989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.215989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.216295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.216295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.216537] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.216704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.216704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.216941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.217061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.218989] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dba32874-38b5-4411-a3c9-effdd63d65c0 is going to be updated. [ 971.229275] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.229469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.229545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.229754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.229896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.241992] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: IN_PROGRESS for 2s [ 971.242307] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.242380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.242413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.242597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.242736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.244317] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.244428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.244494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.244778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.244778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.255448] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba32874-38b5-4411-a3c9-effdd63d65c0 in Status: IN_PROGRESS for 2s [ 971.255448] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: IN_PROGRESS for 2s [ 971.438935] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.495955] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.500050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.501429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.501429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.501429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.522065] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.522253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.522339] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.522599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.522667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.522747] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55815927-bbca-4dbc-be18-77001e3e9c6b is going to be created. [ 971.524746] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.525110] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.525296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.525391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.525584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.525702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.525802] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 971.556530] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.556675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.556745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.557169] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.557366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.559337] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.559493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.559607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.559807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.561096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.570724] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 971.571834] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55815927-bbca-4dbc-be18-77001e3e9c6b in Status: UNINITIALIZED for 2s [ 971.717011] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.811677] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: SUCCESS [ 971.812051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.941977] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.941977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.942163] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.942626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.942626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.942626] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 971.973777] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.973991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.973991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.974292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.974522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.986246] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 972.002998] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.003180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.003286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.003486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.003587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.003822] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b is going to be updated. [ 972.036681] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.036681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.036926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.036977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.037161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.049266] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: IN_PROGRESS for 2s [ 972.088118] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dba32874-38b5-4411-a3c9-effdd63d65c0 in Status: SUCCESS [ 972.088342] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.092502] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: SUCCESS [ 972.092708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.117593] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 972.117826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.220662] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.220662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.220662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.220922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.220922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.221101] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 972.256780] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.256955] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.257068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.257367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.257546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.267821] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 972.975540] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 972.975947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.252324] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 in Status: SUCCESS [ 973.253481] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 deletion is rescheduled due to dependency. [ 973.253481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.266226] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dba32874-38b5-4411-a3c9-effdd63d65c0 in Status: SUCCESS [ 973.266226] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dba32874-38b5-4411-a3c9-effdd63d65c0 deletion is rescheduled due to dependency. [ 973.266226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.266226] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a4863374-5c9e-490a-be11-1eac203337f7 in Status: SUCCESS [ 973.266226] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a4863374-5c9e-490a-be11-1eac203337f7 deletion is rescheduled due to dependency. [ 973.266226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.591127] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 973.591316] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 deletion is rescheduled due to dependency. [ 973.591431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.592161] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55815927-bbca-4dbc-be18-77001e3e9c6b in Status: SUCCESS [ 973.592571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.592571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.592702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.592883] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.592998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.593096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.593337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.593416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.593531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.593910] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55815927-bbca-4dbc-be18-77001e3e9c6b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.029174] env[67003]: INFO networking_nsxv3.common.synchronization [None req-23281fd6-9c10-4ba1-9346-054b51ae6bbd None None] Enqueued Resource ID: 66886209-187b-44fc-9e1a-407c803eeaa1 with Priority: HIGHEST for action port [ 974.031237] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66886209-187b-44fc-9e1a-407c803eeaa1 with Priority: HIGHEST for action port [ 974.031798] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-66886209-187b-44fc-9e1a-407c803eeaa1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.031798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66886209-187b-44fc-9e1a-407c803eeaa1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.032231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66886209-187b-44fc-9e1a-407c803eeaa1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.032231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66886209-187b-44fc-9e1a-407c803eeaa1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.032231] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66886209-187b-44fc-9e1a-407c803eeaa1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.043028] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 974.043272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.064534] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: SUCCESS [ 974.064769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.097211] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55815927-bbca-4dbc-be18-77001e3e9c6b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.278896] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 974.278896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.535100] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 66886209-187b-44fc-9e1a-407c803eeaa1 [ 974.535336] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.535762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.535762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.535762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.535927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.535927] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:66886209-187b-44fc-9e1a-407c803eeaa1 already deleted. [ 974.536083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66886209-187b-44fc-9e1a-407c803eeaa1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.601952] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55815927-bbca-4dbc-be18-77001e3e9c6b: rpc.has_security_group_logging(os_id): False [ 974.619090] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.619660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.620056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.620638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.622191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.622191] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.622191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.622191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.622191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.622191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.622191] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55815927-bbca-4dbc-be18-77001e3e9c6b is going to be created. [ 974.684432] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.684630] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.684751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.685556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.685556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.700146] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55815927-bbca-4dbc-be18-77001e3e9c6b in Status: IN_PROGRESS for 2s [ 974.959356] env[67003]: INFO networking_nsxv3.common.synchronization [None req-25691b0f-fadc-4998-80e8-7ec22cbfbb1d tempest-ServerActionsTestOtherB-185944640 tempest-ServerActionsTestOtherB-185944640-project-member] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_rules [ 974.959971] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_rules [ 974.960343] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.960470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.960549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.960822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.960930] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.081518] env[67003]: INFO networking_nsxv3.common.synchronization [None req-16415276-0edf-4498-91b0-9f421c0a5889 tempest-ServerActionsTestOtherB-185944640 tempest-ServerActionsTestOtherB-185944640-project-member] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_rules [ 975.082242] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_rules [ 975.082911] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.083034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.483092] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.483298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.483362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.483529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.483612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.483711] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 716cf816-3048-4122-8676-0137157fed0e already deleted. [ 975.483790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.483947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.484101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.484179] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.008663] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.009054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.009260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.009568] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.009831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.010270] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 716cf816-3048-4122-8676-0137157fed0e already deleted. [ 976.010270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.071293] env[67003]: INFO networking_nsxv3.common.synchronization [req-b437b1cc-7378-49f6-9f6f-b0a0fa15a965 req-6ade13e5-bc94-4d66-aa3d-a3912d387f43 tempest-ServerDiskConfigTestJSON-448903628 tempest-ServerDiskConfigTestJSON-448903628-project-member] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 976.071834] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 976.072161] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.072284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.073436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.073701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.073964] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.074919] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.075028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.075271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.075323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.075380] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.461077] env[67003]: INFO networking_nsxv3.common.synchronization [None req-69c304bf-6af0-46f5-bdec-45d709de0e12 None None] Enqueued Resource ID: a412537d-922f-471d-b0e5-218981bcc0eb with Priority: HIGHEST for action port [ 976.461629] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a412537d-922f-471d-b0e5-218981bcc0eb with Priority: HIGHEST for action port [ 976.461937] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-a412537d-922f-471d-b0e5-218981bcc0eb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.463081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a412537d-922f-471d-b0e5-218981bcc0eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.463081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a412537d-922f-471d-b0e5-218981bcc0eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.463081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a412537d-922f-471d-b0e5-218981bcc0eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.463081] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a412537d-922f-471d-b0e5-218981bcc0eb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.467346] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.467534] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.467651] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.468798] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.468798] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.468798] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.468798] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.468798] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.468798] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.469211] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.469211] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 976.469211] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 976.469354] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 976.469397] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 976.469486] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 976.469613] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 976.494818] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 976.495075] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 976.495317] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 976.495587] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.496115] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-91821fe3-dc3e-4359-9473-083d2d56bd6e taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.496422] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-91821fe3-dc3e-4359-9473-083d2d56bd6e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.496565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-91821fe3-dc3e-4359-9473-083d2d56bd6e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.497047] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-91821fe3-dc3e-4359-9473-083d2d56bd6e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.497257] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91821fe3-dc3e-4359-9473-083d2d56bd6e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 976.579242] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.579494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.579580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.579806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.579936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.580198] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.580342] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.580450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.580649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.580772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.580907] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 976.609965] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.610197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.610249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.610504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.610690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.628486] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 976.715239] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55815927-bbca-4dbc-be18-77001e3e9c6b in Status: SUCCESS [ 976.715562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.965130] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a412537d-922f-471d-b0e5-218981bcc0eb [ 976.965539] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 976.965736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 976.965941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 976.966288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 976.966288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 976.966375] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a412537d-922f-471d-b0e5-218981bcc0eb already deleted. [ 976.966470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a412537d-922f-471d-b0e5-218981bcc0eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.000589] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.000855] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.000939] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.001243] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.001394] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.001552] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 91821fe3-dc3e-4359-9473-083d2d56bd6e not found, creating... [ 977.001836] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.002051] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.002161] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.002534] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.002771] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.003425] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.003704] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.003982] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.004326] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.004566] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.004789] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 91821fe3-dc3e-4359-9473-083d2d56bd6e is going to be created. [ 977.025529] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.025529] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.025529] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.025778] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.026095] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.026327] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-91821fe3-dc3e-4359-9473-083d2d56bd6e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.534216] env[67003]: INFO networking_nsxv3.common.synchronization [None req-2bd28725-b667-48c4-916b-a8875be6acec None None] Enqueued Resource ID: b3bb5608-d746-4bac-94f8-18a300f2a2af with Priority: HIGHEST for action port [ 977.534216] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3bb5608-d746-4bac-94f8-18a300f2a2af with Priority: HIGHEST for action port [ 977.535236] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3bb5608-d746-4bac-94f8-18a300f2a2af taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.536042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3bb5608-d746-4bac-94f8-18a300f2a2af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.536452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3bb5608-d746-4bac-94f8-18a300f2a2af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.537964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3bb5608-d746-4bac-94f8-18a300f2a2af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.537964] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3bb5608-d746-4bac-94f8-18a300f2a2af',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.722469] env[67003]: INFO networking_nsxv3.common.synchronization [req-b437b1cc-7378-49f6-9f6f-b0a0fa15a965 req-08d7b7b9-cd11-4d2b-9d88-ac615a21826f service nova] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_rules [ 977.722469] env[67003]: INFO networking_nsxv3.common.synchronization [req-b437b1cc-7378-49f6-9f6f-b0a0fa15a965 req-08d7b7b9-cd11-4d2b-9d88-ac615a21826f service nova] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 977.722469] env[67003]: INFO networking_nsxv3.common.synchronization [req-b437b1cc-7378-49f6-9f6f-b0a0fa15a965 req-08d7b7b9-cd11-4d2b-9d88-ac615a21826f service nova] Enqueued Resource ID: 91821fe3-dc3e-4359-9473-083d2d56bd6e with Priority: HIGHEST for action port [ 977.722469] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_rules [ 977.722469] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 977.722469] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91821fe3-dc3e-4359-9473-083d2d56bd6e with Priority: HIGHEST for action port [ 977.722469] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.722469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.722469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.722469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.722469] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.725464] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.725520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.725847] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-91821fe3-dc3e-4359-9473-083d2d56bd6e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.725966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91821fe3-dc3e-4359-9473-083d2d56bd6e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.725966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91821fe3-dc3e-4359-9473-083d2d56bd6e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.726950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91821fe3-dc3e-4359-9473-083d2d56bd6e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.726950] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91821fe3-dc3e-4359-9473-083d2d56bd6e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.041584] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b3bb5608-d746-4bac-94f8-18a300f2a2af [ 978.042082] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.042272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.042368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.043043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.043043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.043043] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b3bb5608-d746-4bac-94f8-18a300f2a2af already deleted. [ 978.043043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3bb5608-d746-4bac-94f8-18a300f2a2af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.228601] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.228716] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.228910] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 91821fe3-dc3e-4359-9473-083d2d56bd6e with status ACTIVE [ 978.229263] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.229390] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.229456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.229668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.229755] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.229930] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.230064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.230098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.230255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.230331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.230508] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.230614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.230695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.230836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.230923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.230991] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 91821fe3-dc3e-4359-9473-083d2d56bd6e is going to be updated. [ 978.263329] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.263527] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.263574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.263797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.263959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.264150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91821fe3-dc3e-4359-9473-083d2d56bd6e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.343471] env[67003]: INFO networking_nsxv3.common.synchronization [req-36c97b80-217d-4d0a-85ef-3d0ec527a4af req-c829f445-ab81-4501-84cf-3aa91d1d8bde tempest-ServersTestManualDisk-372424363 tempest-ServersTestManualDisk-372424363-project-member] Enqueued Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGHEST for action security_group_members [ 978.343586] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGHEST for action security_group_members [ 978.343820] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-11ed018b-2f29-4f20-913e-d07a9663638e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.344320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.344320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.344320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.344320] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.344491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.344491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.345366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.345366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.345366] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('11ed018b-2f29-4f20-913e-d07a9663638e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.641608] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 978.641939] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 deletion is rescheduled due to dependency. [ 978.641939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.642029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.643688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.643688] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.643688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.643688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.643688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.643688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.643688] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.848841] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.849102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.850020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.850020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.885339] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.886064] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.886249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.886249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.886708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.886708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.886708] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ed018b-2f29-4f20-913e-d07a9663638e is going to be updated. [ 978.924027] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.924027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.924027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.924310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.924310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.937042] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ed018b-2f29-4f20-913e-d07a9663638e in Status: IN_PROGRESS for 2s [ 979.147787] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.350024] env[67003]: INFO networking_nsxv3.common.synchronization [None req-7df6e8b9-e5cd-4631-9f03-24e1e582bafb tempest-ServerActionsV293TestJSON-1797352496 tempest-ServerActionsV293TestJSON-1797352496-project-member] Enqueued Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGHEST for action security_group_rules [ 979.350024] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGHEST for action security_group_rules [ 979.350024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.350024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.350024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.353556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.353556] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.504172] env[67003]: INFO networking_nsxv3.common.synchronization [None req-33ef5feb-7fb4-4f04-8eb3-a45367b395ae tempest-ServerActionsV293TestJSON-1797352496 tempest-ServerActionsV293TestJSON-1797352496-project-member] Enqueued Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGHEST for action security_group_rules [ 979.504786] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGHEST for action security_group_rules [ 979.505753] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.505753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.615390] env[67003]: INFO networking_nsxv3.common.synchronization [None req-7accbca3-82a7-4479-b965-26b701cdbb42 None None] Enqueued Resource ID: ee678452-cf33-481c-b2cf-6d64bd6e736d with Priority: HIGHEST for action port [ 979.615936] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee678452-cf33-481c-b2cf-6d64bd6e736d with Priority: HIGHEST for action port [ 979.617074] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee678452-cf33-481c-b2cf-6d64bd6e736d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.617371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee678452-cf33-481c-b2cf-6d64bd6e736d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.617468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee678452-cf33-481c-b2cf-6d64bd6e736d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.617727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee678452-cf33-481c-b2cf-6d64bd6e736d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.617808] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee678452-cf33-481c-b2cf-6d64bd6e736d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.657766] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.873612] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.873807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.873869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.874128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.874251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.874359] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a already deleted. [ 979.874514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.874718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.874942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.875131] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.121259] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ee678452-cf33-481c-b2cf-6d64bd6e736d [ 980.122653] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.122653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.122653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.122653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.122653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.122653] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ee678452-cf33-481c-b2cf-6d64bd6e736d already deleted. [ 980.122653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee678452-cf33-481c-b2cf-6d64bd6e736d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.159058] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.159220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.159292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.159500] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.159588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.159688] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 980.195188] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.195514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.195666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.195809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.196063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.206665] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 980.410573] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 980.410841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 980.411282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 980.411282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 980.411282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.411434] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a already deleted. [ 980.411468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.948468] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 11ed018b-2f29-4f20-913e-d07a9663638e in Status: SUCCESS [ 980.948675] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 11ed018b-2f29-4f20-913e-d07a9663638e deletion is rescheduled due to dependency. [ 980.948899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.764546] env[67003]: INFO networking_nsxv3.common.synchronization [req-4eb9f038-0fbb-4670-867f-3cff5ca3119d req-46133ef9-4841-448d-97a8-423751e5d2fc tempest-ImagesTestJSON-830230457 tempest-ImagesTestJSON-830230457-project-member] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 981.765093] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 981.765407] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.765528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.765588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.765787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.765936] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.766090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.766155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.766296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.766381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.766473] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.218598] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 982.218881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.218973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.219840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.220462] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.220462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.220752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.220829] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.221805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.221805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.221805] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.271362] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.271668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.272954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.272954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.299037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.299037] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.299037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.299293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.299293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.299382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.299459] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 982.333524] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.335269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.335368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.335653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.335839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.350026] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 982.729399] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.729399] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.729399] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.729399] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.729399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.730227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.730227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.730227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.730227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.730227] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.886743] env[67003]: INFO networking_nsxv3.common.synchronization [req-67ab22a6-ee03-426b-b74c-6309fa2bab2a req-36860134-0c56-4697-91db-6b1b38ec706c tempest-MigrationsAdminTest-779889772 tempest-MigrationsAdminTest-779889772-project-member] Enqueued Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_members [ 982.887940] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGHEST for action security_group_members [ 982.887940] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.887940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.888285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.888285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.888485] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.888602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.888602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.888817] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.888894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.888996] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.234197] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25f0058d-8729-4623-a291-7d3376597063: rpc.has_security_group_logging(os_id): False [ 983.252754] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.252878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.252953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.253506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.253506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.253506] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.253663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.253663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.253971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.253971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.254138] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.254138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.254206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.254354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.254404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.254557] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.254927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.254927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.254927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.254927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.255277] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 983.327499] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.327675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.327739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.328019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.328180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.346403] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 983.392041] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.392259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.392321] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.392575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.436839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.437158] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.437286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.437356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.437561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.437647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.437734] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b is going to be updated. [ 983.470747] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.470900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.470900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.471334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.471334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.481419] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: IN_PROGRESS for 2s [ 984.366519] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 984.367228] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 deletion is rescheduled due to dependency. [ 984.367408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.363468] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 985.363689] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.501917] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b in Status: SUCCESS [ 985.502213] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b deletion is rescheduled due to dependency. [ 985.502213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.311471] env[67003]: INFO networking_nsxv3.common.synchronization [req-a00bb0d1-1d03-4fd6-bb65-628e4da0ddfc req-e3a58036-7b53-413e-b0a9-2a44a5bb70ac tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: 879b3713-7487-492d-b6e1-77747451fce3 with Priority: HIGHEST for action security_group_members [ 986.311471] env[67003]: INFO networking_nsxv3.common.synchronization [req-a00bb0d1-1d03-4fd6-bb65-628e4da0ddfc req-e3a58036-7b53-413e-b0a9-2a44a5bb70ac tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 986.311471] env[67003]: INFO networking_nsxv3.common.synchronization [req-a00bb0d1-1d03-4fd6-bb65-628e4da0ddfc req-e3a58036-7b53-413e-b0a9-2a44a5bb70ac tempest-SecurityGroupsTestJSON-1442540024 tempest-SecurityGroupsTestJSON-1442540024-project-member] Enqueued Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_members [ 986.311471] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 879b3713-7487-492d-b6e1-77747451fce3 with Priority: HIGHEST for action security_group_members [ 986.313856] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGHEST for action security_group_members [ 986.314057] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGHEST for action security_group_members [ 986.314752] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-879b3713-7487-492d-b6e1-77747451fce3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.314752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.314752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.315742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.315742] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.315742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.315742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.315742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.315742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.315742] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('879b3713-7487-492d-b6e1-77747451fce3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.316929] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.317109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.317265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.317351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.318033] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.318033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.318033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.318033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.318033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.318033] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.319622] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ea11303f-c0fb-4922-8c26-9eb29fdbf672 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.319739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.319798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.320048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.320637] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.320750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.320816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.320995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.321157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.321263] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.822894] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.823331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.823331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.823541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.824705] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.824840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.825226] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.825414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.850093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.850627] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.850833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.851040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.851372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.851507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.851656] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 879b3713-7487-492d-b6e1-77747451fce3 is going to be updated. [ 986.853907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.854914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.854914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.854914] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.854914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.854914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.855524] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.855524] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.855524] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be updated. [ 986.859029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.859029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.883240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.883740] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.883962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.884137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.884513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.884684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.884883] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 is going to be updated. [ 986.898431] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.898659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.898724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.898968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.899139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.901213] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.901365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.901365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.901797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.901797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.914441] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 879b3713-7487-492d-b6e1-77747451fce3 in Status: IN_PROGRESS for 2s [ 986.915539] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: IN_PROGRESS for 2s [ 986.924823] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.925285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.925482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.925856] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.926181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.937807] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: IN_PROGRESS for 2s [ 987.481143] env[67003]: INFO networking_nsxv3.common.synchronization [req-4f13a181-cad8-4b25-8aab-b0f79d3f11e7 req-a78fc558-a4f5-42ee-b380-26166c932e3c tempest-ServerActionsTestOtherB-185944640 tempest-ServerActionsTestOtherB-185944640-project-member] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 987.481920] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 987.482404] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.484614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.484614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.484614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.484614] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.484614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.484614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.484614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.484614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.484614] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.871350] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.871704] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.871816] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.872215] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.872866] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.872866] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.873291] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.873291] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.873396] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.873740] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 987.873837] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 987.874029] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 987.874292] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 987.874503] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 987.874661] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 987.874848] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 987.903733] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 987.904103] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 987.904291] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 987.904507] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.905031] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-dae55e8e-4154-4477-84d4-f56641b00f8c taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.905481] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-dae55e8e-4154-4477-84d4-f56641b00f8c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.905481] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-dae55e8e-4154-4477-84d4-f56641b00f8c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.905908] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-dae55e8e-4154-4477-84d4-f56641b00f8c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.906161] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dae55e8e-4154-4477-84d4-f56641b00f8c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.986710] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.986900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.986983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.987223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.987322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.987532] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.987926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.987926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.987926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.987926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.988113] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e already deleted. [ 987.988113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.408621] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.408853] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.408980] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.409345] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.409523] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.409662] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port dae55e8e-4154-4477-84d4-f56641b00f8c not found, creating... [ 988.409949] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.410108] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.410227] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.410455] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.410593] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.410906] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.411075] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.411194] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.411399] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.411525] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.411663] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: dae55e8e-4154-4477-84d4-f56641b00f8c is going to be created. [ 988.433763] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.434024] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.434122] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.434397] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.434627] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.434884] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-dae55e8e-4154-4477-84d4-f56641b00f8c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.927282] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 in Status: SUCCESS [ 988.927549] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 deletion is rescheduled due to dependency. [ 988.927583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.928307] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 879b3713-7487-492d-b6e1-77747451fce3 in Status: SUCCESS [ 988.928454] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 879b3713-7487-492d-b6e1-77747451fce3 deletion is rescheduled due to dependency. [ 988.928548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.946631] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 in Status: SUCCESS [ 988.946810] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 deletion is rescheduled due to dependency. [ 988.947541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.132699] env[67003]: INFO networking_nsxv3.common.synchronization [req-4f13a181-cad8-4b25-8aab-b0f79d3f11e7 req-ad7c8314-e9a7-49ba-b2a0-169f8d647e22 service nova] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_rules [ 989.132888] env[67003]: INFO networking_nsxv3.common.synchronization [req-4f13a181-cad8-4b25-8aab-b0f79d3f11e7 req-ad7c8314-e9a7-49ba-b2a0-169f8d647e22 service nova] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 989.133042] env[67003]: INFO networking_nsxv3.common.synchronization [req-4f13a181-cad8-4b25-8aab-b0f79d3f11e7 req-ad7c8314-e9a7-49ba-b2a0-169f8d647e22 service nova] Enqueued Resource ID: dae55e8e-4154-4477-84d4-f56641b00f8c with Priority: HIGHEST for action port [ 989.133491] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_rules [ 989.133491] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 989.133491] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dae55e8e-4154-4477-84d4-f56641b00f8c with Priority: HIGHEST for action port [ 989.134376] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.134593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.134739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.134941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.135043] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.135860] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.135981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.136068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.136230] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.136696] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.136820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.136887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.137283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.137374] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.137477] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.138229] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-dae55e8e-4154-4477-84d4-f56641b00f8c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.138425] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dae55e8e-4154-4477-84d4-f56641b00f8c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.138495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dae55e8e-4154-4477-84d4-f56641b00f8c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.138646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dae55e8e-4154-4477-84d4-f56641b00f8c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.138749] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dae55e8e-4154-4477-84d4-f56641b00f8c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.380786] env[67003]: INFO networking_nsxv3.common.synchronization [req-216cbec5-e627-42dc-a330-22a4a6e8ba7f req-31d1c1c0-38df-4df5-872f-742625d3f533 tempest-ImagesTestJSON-830230457 tempest-ImagesTestJSON-830230457-project-member] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 989.381826] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 989.382292] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.382618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.382767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.383108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.383440] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.383652] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.383790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.384070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.384251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.384570] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.640690] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.640822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.641013] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.642069] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dae55e8e-4154-4477-84d4-f56641b00f8c with status ACTIVE [ 989.642152] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.642260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.642451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.642523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.642571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.642912] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.642912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.642912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.643971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.643971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.643971] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.643971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.643971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.643971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.643971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.643971] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dae55e8e-4154-4477-84d4-f56641b00f8c is going to be updated. [ 989.667024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.667024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.667024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.667024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.667024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.667024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dae55e8e-4154-4477-84d4-f56641b00f8c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.731682] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-423 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.731904] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.732060] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.732343] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.733021] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.733021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.733021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.733216] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.733338] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.733568] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.733692] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 989.733817] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 989.733926] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 989.734069] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 989.734167] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 989.734311] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 989.758923] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 989.759060] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 989.759220] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 989.759416] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-423" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.759774] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-f5208b77-d1b4-4479-adca-0ce9aed04a1d taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.759969] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-f5208b77-d1b4-4479-adca-0ce9aed04a1d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.760136] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-f5208b77-d1b4-4479-adca-0ce9aed04a1d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.760477] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-f5208b77-d1b4-4479-adca-0ce9aed04a1d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.760632] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5208b77-d1b4-4479-adca-0ce9aed04a1d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.889772] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.889942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.890022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.890256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.890373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.890568] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.890674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.890725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.890884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.890970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.891072] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 989.921811] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.921916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.922020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.922245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.922408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.933576] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 990.146374] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.265044] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.265359] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.265437] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.265670] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.265832] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.265962] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port f5208b77-d1b4-4479-adca-0ce9aed04a1d not found, creating... [ 990.268099] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.268099] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.268099] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.268099] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.268099] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.268099] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.268099] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.268099] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.268099] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.268099] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.268559] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: f5208b77-d1b4-4479-adca-0ce9aed04a1d is going to be created. [ 990.289181] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.289635] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.289823] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.290158] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.290507] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.290828] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-f5208b77-d1b4-4479-adca-0ce9aed04a1d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.650197] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.650197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.650197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.650197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.650197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.650197] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be created. [ 990.688705] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.688705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.688705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.689520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.689520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.708786] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: UNINITIALIZED for 2s [ 991.079212] env[67003]: INFO networking_nsxv3.common.synchronization [req-216cbec5-e627-42dc-a330-22a4a6e8ba7f req-db195b0e-9590-444b-9953-4cd2c90f8ecd service nova] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_rules [ 991.079551] env[67003]: INFO networking_nsxv3.common.synchronization [req-216cbec5-e627-42dc-a330-22a4a6e8ba7f req-db195b0e-9590-444b-9953-4cd2c90f8ecd service nova] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 991.079551] env[67003]: INFO networking_nsxv3.common.synchronization [req-216cbec5-e627-42dc-a330-22a4a6e8ba7f req-db195b0e-9590-444b-9953-4cd2c90f8ecd service nova] Enqueued Resource ID: f5208b77-d1b4-4479-adca-0ce9aed04a1d with Priority: HIGHEST for action port [ 991.080205] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_rules [ 991.080362] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 991.080745] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5208b77-d1b4-4479-adca-0ce9aed04a1d with Priority: HIGHEST for action port [ 991.081173] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.081371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.081433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.081682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.081779] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.083102] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.083218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.083548] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5208b77-d1b4-4479-adca-0ce9aed04a1d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.083548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5208b77-d1b4-4479-adca-0ce9aed04a1d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.083859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5208b77-d1b4-4479-adca-0ce9aed04a1d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.083859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5208b77-d1b4-4479-adca-0ce9aed04a1d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.084086] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5208b77-d1b4-4479-adca-0ce9aed04a1d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.586582] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.586808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.586857] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f5208b77-d1b4-4479-adca-0ce9aed04a1d with status ACTIVE [ 991.587265] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.587465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.587528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.587777] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.587891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.588114] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.588222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.588290] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.588470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.588553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.588748] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.588849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.588913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.589074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.589155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.589246] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f5208b77-d1b4-4479-adca-0ce9aed04a1d is going to be updated. [ 991.626687] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.626767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.626767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.626992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.627305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.627511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5208b77-d1b4-4479-adca-0ce9aed04a1d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.947673] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 991.947673] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 deletion is rescheduled due to dependency. [ 991.947986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.947986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.948278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.948374] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.949460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.949587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.949909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.950029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.950146] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.041946] env[67003]: INFO networking_nsxv3.common.synchronization [req-2ac12188-b90d-4bb8-8def-97d484ad9baa req-1260dc88-f733-4bde-adc9-549438439e4e tempest-ServersTestBootFromVolume-709358174 tempest-ServersTestBootFromVolume-709358174-project-member] Enqueued Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGHEST for action security_group_members [ 992.044556] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGHEST for action security_group_members [ 992.046694] env[67003]: INFO networking_nsxv3.common.synchronization [req-39ca48fd-8446-49c2-bdc7-bd2bbb1e09a3 req-bedcfaec-4553-498c-b37e-df9bc0ec6a58 tempest-ServersTestJSON-1317110385 tempest-ServersTestJSON-1317110385-project-member] Enqueued Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGHEST for action security_group_members [ 992.047057] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1fb9da3-caa0-493e-935e-25393509c210 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.047262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.047262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.047431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.047587] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.047684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.047746] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.047889] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.047973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.048084] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1fb9da3-caa0-493e-935e-25393509c210',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.049206] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGHEST for action security_group_members [ 992.049733] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-3cc0841b-286c-4904-bf0d-135e41f2566e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.049847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.049946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.050433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.050578] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.050707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.050791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.050962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.051135] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.051386] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3cc0841b-286c-4904-bf0d-135e41f2566e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.455223] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.552662] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.552662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.552662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.552662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.553622] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.553823] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.575993] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.576331] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.576456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.576524] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.576724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.576806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.576894] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1fb9da3-caa0-493e-935e-25393509c210 is going to be updated. [ 992.577872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.578102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.596742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.596849] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.596914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.596995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.597995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.597995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.597995] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc0841b-286c-4904-bf0d-135e41f2566e is going to be updated. [ 992.611328] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.611556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.611556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.611720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.611862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.624893] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1fb9da3-caa0-493e-935e-25393509c210 in Status: IN_PROGRESS for 2s [ 992.626355] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.626555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.626667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.626963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.627196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.635792] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc0841b-286c-4904-bf0d-135e41f2566e in Status: IN_PROGRESS for 2s [ 992.721739] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 992.723292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.723292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.723292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.723420] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.723571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.723644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.723820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.723904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.724009] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.724111] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.958650] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.226840] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.461337] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.462754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.462754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.462754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.462754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.462754] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 993.503657] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.503657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.503657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.503936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.504274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.515650] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 993.731284] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 716cf816-3048-4122-8676-0137157fed0e: rpc.has_security_group_logging(os_id): False [ 993.750080] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.750289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.750394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.750574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.750662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.750932] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.751101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.751278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.751378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.751467] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.751554] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be created. [ 993.830458] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.830458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.830681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.831101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.831180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.847112] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 2s [ 994.636037] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1fb9da3-caa0-493e-935e-25393509c210 in Status: SUCCESS [ 994.636037] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1fb9da3-caa0-493e-935e-25393509c210 deletion is rescheduled due to dependency. [ 994.636909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.646081] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3cc0841b-286c-4904-bf0d-135e41f2566e in Status: SUCCESS [ 994.646081] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3cc0841b-286c-4904-bf0d-135e41f2566e deletion is rescheduled due to dependency. [ 994.646081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.528520] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 995.528520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.528520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.528520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.528520] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.528520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.528520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.528520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.528520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.528520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.528520] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.861523] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 995.861523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.030810] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.034020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.034020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.034020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.034020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.034862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.034862] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.538151] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c06f8726-ef82-4058-ad8d-7e0aabd079e1: rpc.has_security_group_logging(os_id): False [ 996.561051] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.561051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.561051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.561051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.561273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.562265] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.562265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.562265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.562265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.562265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.562265] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.562265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.562265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.562265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.563197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.563197] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.563197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.563197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.563197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.563197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.563197] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 996.662226] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.662226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.662226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.662606] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.662606] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.694864] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 997.050596] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 997.050596] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 997.388086] env[67003]: INFO networking_nsxv3.common.synchronization [None req-08b1f9d6-b490-4787-b839-a1e3ac9d71c2 None None] Enqueued Resource ID: 794ae498-cd0e-45bb-949a-46fd1d76036a with Priority: HIGHEST for action port [ 997.388606] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 794ae498-cd0e-45bb-949a-46fd1d76036a with Priority: HIGHEST for action port [ 997.388921] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-794ae498-cd0e-45bb-949a-46fd1d76036a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.389048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-794ae498-cd0e-45bb-949a-46fd1d76036a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.389134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-794ae498-cd0e-45bb-949a-46fd1d76036a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.389381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-794ae498-cd0e-45bb-949a-46fd1d76036a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.389467] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('794ae498-cd0e-45bb-949a-46fd1d76036a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.893613] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 794ae498-cd0e-45bb-949a-46fd1d76036a [ 997.893862] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.894138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.894212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.894457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.894545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.894645] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:794ae498-cd0e-45bb-949a-46fd1d76036a already deleted. [ 997.894723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-794ae498-cd0e-45bb-949a-46fd1d76036a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.710926] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 998.711210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.793525] env[67003]: INFO networking_nsxv3.common.synchronization [None req-2ff2b439-78f8-41db-a5ca-10cac0325a68 None None] Enqueued Resource ID: 093710b7-c234-45fb-9725-239c8bd38b93 with Priority: HIGHEST for action port [ 999.794126] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 093710b7-c234-45fb-9725-239c8bd38b93 with Priority: HIGHEST for action port [ 999.794441] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-093710b7-c234-45fb-9725-239c8bd38b93 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.794566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-093710b7-c234-45fb-9725-239c8bd38b93" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.794634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-093710b7-c234-45fb-9725-239c8bd38b93" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.794883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-093710b7-c234-45fb-9725-239c8bd38b93" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.794967] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('093710b7-c234-45fb-9725-239c8bd38b93',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.303050] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 093710b7-c234-45fb-9725-239c8bd38b93 [ 1000.303050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.303364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.303364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.303937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.303937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.304154] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:093710b7-c234-45fb-9725-239c8bd38b93 already deleted. [ 1000.304213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-093710b7-c234-45fb-9725-239c8bd38b93" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.795585] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1004.795585] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1004.869947] env[67003]: INFO networking_nsxv3.common.synchronization [req-cc4d1070-da9e-4bea-a87a-dbb05affa8f4 req-021adce8-ad9a-4b96-9522-7d9294e83a17 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1004.871093] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1004.871294] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.871478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.871560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.871863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.872134] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.872275] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.872341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.872516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.872608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.872705] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.246340] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.246340] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.246340] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.246549] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.246675] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.246914] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.246974] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.247460] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.247660] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.247910] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.248064] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.248213] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.248364] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.248769] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.248769] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.248950] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.272165] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.272165] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1005.272165] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.272165] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.272165] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-a5de3f78-fd41-43c0-ab5f-059f26e11b9f taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.272165] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-a5de3f78-fd41-43c0-ab5f-059f26e11b9f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.272165] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-a5de3f78-fd41-43c0-ab5f-059f26e11b9f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.272165] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-a5de3f78-fd41-43c0-ab5f-059f26e11b9f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.272165] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5de3f78-fd41-43c0-ab5f-059f26e11b9f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.376405] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.376405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.376405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.376405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.376405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.376405] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.377225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.377225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.377225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.377225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.377225] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be deleted. [ 1005.411109] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.411318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.411318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.411540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.411644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.411742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.774356] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.774589] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.774716] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.774981] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.775147] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.775300] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port a5de3f78-fd41-43c0-ab5f-059f26e11b9f not found, creating... [ 1005.775557] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.775710] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.775829] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.776060] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.776218] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.776501] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.776655] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.776770] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.777077] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.777374] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.777555] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: a5de3f78-fd41-43c0-ab5f-059f26e11b9f is going to be created. [ 1005.800704] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.801232] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.801232] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.801601] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.801897] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.802371] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-a5de3f78-fd41-43c0-ab5f-059f26e11b9f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.589305] env[67003]: INFO networking_nsxv3.common.synchronization [req-cc4d1070-da9e-4bea-a87a-dbb05affa8f4 req-6754c036-cd32-4ce9-99c8-a371b3add945 service nova] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_rules [ 1006.589505] env[67003]: INFO networking_nsxv3.common.synchronization [req-cc4d1070-da9e-4bea-a87a-dbb05affa8f4 req-6754c036-cd32-4ce9-99c8-a371b3add945 service nova] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1006.589685] env[67003]: INFO networking_nsxv3.common.synchronization [req-cc4d1070-da9e-4bea-a87a-dbb05affa8f4 req-6754c036-cd32-4ce9-99c8-a371b3add945 service nova] Enqueued Resource ID: a5de3f78-fd41-43c0-ab5f-059f26e11b9f with Priority: HIGHEST for action port [ 1006.591660] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_rules [ 1006.592013] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1006.592201] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5de3f78-fd41-43c0-ab5f-059f26e11b9f with Priority: HIGHEST for action port [ 1006.593198] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.593330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.593453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.594417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.594564] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.596165] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.596165] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.596165] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.597907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.598043] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.598179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.598256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.598449] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.598539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.598645] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.601508] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-a5de3f78-fd41-43c0-ab5f-059f26e11b9f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.601508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a5de3f78-fd41-43c0-ab5f-059f26e11b9f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.601508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a5de3f78-fd41-43c0-ab5f-059f26e11b9f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.602095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a5de3f78-fd41-43c0-ab5f-059f26e11b9f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.602095] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a5de3f78-fd41-43c0-ab5f-059f26e11b9f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.104176] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a5de3f78-fd41-43c0-ab5f-059f26e11b9f with status ACTIVE [ 1007.104495] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.104574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.104616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.104886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.105086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.105340] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.105740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.105740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.105740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.105740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.105920] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.106018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.106078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.106250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.106321] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.106406] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a5de3f78-fd41-43c0-ab5f-059f26e11b9f is going to be updated. [ 1007.107999] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.109242] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.109426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.130303] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.130465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.130542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.130768] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.131361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.131361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a5de3f78-fd41-43c0-ab5f-059f26e11b9f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.611871] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.113745] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.114169] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.114169] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.114283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.114411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.114555] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be created. [ 1008.147026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.147228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.147228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.147557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.147687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.168945] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: UNINITIALIZED for 2s [ 1009.031683] env[67003]: INFO networking_nsxv3.common.synchronization [req-03cff380-ab32-4592-8003-6aac6ec01bdb req-143d2d0b-203d-451f-a299-1922ad7c5f68 tempest-DeleteServersTestJSON-1342989894 tempest-DeleteServersTestJSON-1342989894-project-member] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1009.032305] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1009.033038] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.033038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.033038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.033235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.033396] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.033525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.033590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.033761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.034423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.034423] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.536776] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.537646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.537766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.537927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.538029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.538248] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.538346] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.538427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.538582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.538660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.538747] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1009.570741] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.570951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.570994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.571221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.571380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.581802] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1010.182360] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 1010.183053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.183053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.184239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.184239] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.184239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.184239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.184239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.184239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.184239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.184239] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.686250] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.686578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.686578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.686699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.686868] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.686970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.687042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.687202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.687449] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.687449] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.687547] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.687602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.687656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.687795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.687933] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.688033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.688089] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.688235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.688325] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.688432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.688532] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.195570] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a: rpc.has_security_group_logging(os_id): False [ 1011.218021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.218021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.218021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.218021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.218021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.218021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.218021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.218021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.218021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.218021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.218021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.218021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.218021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.218021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.218021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.218693] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.218693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.218872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.219208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.219396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.219580] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be created. [ 1011.306056] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.307017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.307017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.307017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.307017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.325789] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: IN_PROGRESS for 2s [ 1011.508411] env[67003]: INFO networking_nsxv3.common.synchronization [None req-2e081908-388e-4d6a-a723-cba22513c3ce tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1011.508411] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1011.508411] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.509505] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.509787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.511211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.511211] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.511966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.511966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.511966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.511966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.511966] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.595074] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1011.595270] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 deletion is rescheduled due to dependency. [ 1011.595846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.938129] env[67003]: INFO networking_nsxv3.common.synchronization [None req-0fcebd2f-d053-4e72-9def-c6d94cc0e746 None None] Enqueued Resource ID: 29cd3f77-c16f-4914-a980-b981fb3e96df with Priority: HIGHEST for action port [ 1011.939806] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29cd3f77-c16f-4914-a980-b981fb3e96df with Priority: HIGHEST for action port [ 1011.939806] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-29cd3f77-c16f-4914-a980-b981fb3e96df taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.939806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29cd3f77-c16f-4914-a980-b981fb3e96df" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.939806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29cd3f77-c16f-4914-a980-b981fb3e96df" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.939806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29cd3f77-c16f-4914-a980-b981fb3e96df" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.939806] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29cd3f77-c16f-4914-a980-b981fb3e96df',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.016462] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.443250] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29cd3f77-c16f-4914-a980-b981fb3e96df [ 1012.443548] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.443693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.443765] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.444117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.444270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.444349] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29cd3f77-c16f-4914-a980-b981fb3e96df already deleted. [ 1012.444424] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29cd3f77-c16f-4914-a980-b981fb3e96df" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.519113] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.859332] env[67003]: INFO networking_nsxv3.common.synchronization [req-0ed741f3-87f8-47c7-959f-819edcdfe093 req-0feea6d1-0289-434e-bc09-be33eb34ac78 tempest-ImagesNegativeTestJSON-104515178 tempest-ImagesNegativeTestJSON-104515178-project-member] Enqueued Resource ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b with Priority: HIGHEST for action security_group_members [ 1012.859759] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b with Priority: HIGHEST for action security_group_members [ 1012.860026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.860149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.860219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.860548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.860728] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.861019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.861019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.861134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.861220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.861328] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac5d0186-3918-4fee-aaf4-b2a10d31eb1b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.023022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.023022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.023022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.023022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.023022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.023022] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be updated. [ 1013.057418] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.057418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.057418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.057418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.057731] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.068067] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: IN_PROGRESS for 2s [ 1013.248863] env[67003]: INFO networking_nsxv3.common.synchronization [req-03281d57-2eb6-4782-8ea9-fbd025d1f09b req-8621b795-a57e-4eaa-a87f-63b9d70b417b tempest-ImagesTestJSON-830230457 tempest-ImagesTestJSON-830230457-project-member] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 1013.249473] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGHEST for action security_group_members [ 1013.249839] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.251320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.251320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.251570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.253074] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.253074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.253074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.253074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.253074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.253074] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.295660] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-454 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.296776] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-454" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.301021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-454" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.301021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-454" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.301021] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.301021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.301021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.301021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.301021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.301021] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.301021] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.301021] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.301021] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.301021] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.302229] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.302417] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.326869] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.328018] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.328018] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.328018] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-454" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.328018] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.328279] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.328279] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.328650] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.328700] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.345074] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 1013.345334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.364033] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.364232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.364308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.364528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.364619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.364814] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.364914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.364976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.365139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.365215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.365315] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b already deleted. [ 1013.365412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.755121] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.755372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.755372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.755610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.755734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.755964] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.756106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.756172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.756534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.756534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.756661] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be updated. [ 1013.788402] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.788561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.788633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.788840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.788980] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.801121] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: IN_PROGRESS for 2s [ 1013.833044] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.833301] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.833429] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.833703] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.833878] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.834090] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16 not found, creating... [ 1013.834419] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.834610] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.834750] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.835038] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.835199] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.835512] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.835831] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.835965] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.836320] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.836478] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.836657] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16 is going to be created. [ 1013.858374] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.858660] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.858788] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.859093] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.859354] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.859622] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.901610] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.901969] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.902154] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.902491] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.903259] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.903538] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.903781] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.904072] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.904268] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.904495] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.904651] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1013.904769] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1013.904911] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1013.905042] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1013.905179] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1013.905354] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1013.926037] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1013.926342] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1013.926401] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1013.926676] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.927184] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-b049119f-a97a-4bad-b45d-92fb699c27f2 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.927400] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-b049119f-a97a-4bad-b45d-92fb699c27f2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.927601] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-b049119f-a97a-4bad-b45d-92fb699c27f2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.927928] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-b049119f-a97a-4bad-b45d-92fb699c27f2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.928100] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b049119f-a97a-4bad-b45d-92fb699c27f2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.145730] env[67003]: INFO networking_nsxv3.common.synchronization [None req-af210840-8435-4cf4-855f-cc325988bbc7 None None] Enqueued Resource ID: 25327c4b-c3c9-4e75-880f-2032738b89ff with Priority: HIGHEST for action port [ 1014.146335] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25327c4b-c3c9-4e75-880f-2032738b89ff with Priority: HIGHEST for action port [ 1014.146659] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-25327c4b-c3c9-4e75-880f-2032738b89ff taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.146780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25327c4b-c3c9-4e75-880f-2032738b89ff" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.146846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25327c4b-c3c9-4e75-880f-2032738b89ff" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.147119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25327c4b-c3c9-4e75-880f-2032738b89ff" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.147194] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25327c4b-c3c9-4e75-880f-2032738b89ff',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.431557] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.431824] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.431958] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.432293] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.432446] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.432604] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port b049119f-a97a-4bad-b45d-92fb699c27f2 not found, creating... [ 1014.432887] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.433057] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.433185] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.433411] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.433558] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.433837] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.434012] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.434140] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.434406] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.434559] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.434701] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: b049119f-a97a-4bad-b45d-92fb699c27f2 is going to be created. [ 1014.459963] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.460197] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.460341] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.460620] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.461914] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.461914] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-b049119f-a97a-4bad-b45d-92fb699c27f2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.577489] env[67003]: INFO networking_nsxv3.common.synchronization [req-0ed741f3-87f8-47c7-959f-819edcdfe093 req-edbef481-f4a1-446d-9c0b-003d86e714ba service nova] Enqueued Resource ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b with Priority: HIGHEST for action security_group_rules [ 1014.577489] env[67003]: INFO networking_nsxv3.common.synchronization [req-0ed741f3-87f8-47c7-959f-819edcdfe093 req-edbef481-f4a1-446d-9c0b-003d86e714ba service nova] Enqueued Resource ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b with Priority: HIGHEST for action security_group_members [ 1014.577489] env[67003]: INFO networking_nsxv3.common.synchronization [req-0ed741f3-87f8-47c7-959f-819edcdfe093 req-edbef481-f4a1-446d-9c0b-003d86e714ba service nova] Enqueued Resource ID: 6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16 with Priority: HIGHEST for action port [ 1014.578508] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b with Priority: HIGHEST for action security_group_rules [ 1014.578794] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b with Priority: HIGHEST for action security_group_members [ 1014.579036] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16 with Priority: HIGHEST for action port [ 1014.579469] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.579773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.579987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.580490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.580717] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac5d0186-3918-4fee-aaf4-b2a10d31eb1b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.582757] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.583085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.583264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.583615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.586020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.586020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.586020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.586020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.586020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.586020] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac5d0186-3918-4fee-aaf4-b2a10d31eb1b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.586020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.586702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.586899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.587283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.587505] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.650234] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 25327c4b-c3c9-4e75-880f-2032738b89ff [ 1014.650234] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.650234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.650234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.650234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.650234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.650234] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:25327c4b-c3c9-4e75-880f-2032738b89ff already deleted. [ 1014.650234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25327c4b-c3c9-4e75-880f-2032738b89ff" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.077771] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 1015.077962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.089937] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ac5d0186-3918-4fee-aaf4-b2a10d31eb1b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.090782] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.090862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.091213] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16 with status ACTIVE [ 1015.092758] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.092758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.092758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.092758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.092758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.092758] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.092758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.092758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.092758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.092758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.093114] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.093114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.093114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.094327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.094327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.094327] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16 is going to be updated. [ 1015.121374] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.121572] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.121685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.122036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.122255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.122474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eb2aeed-e7c7-4c69-bcf2-606ae5e8ba16" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.178232] env[67003]: INFO networking_nsxv3.common.synchronization [req-39d78865-0b5d-4049-b221-0e6a0652fc04 req-0db44e34-1f10-4f5c-b7a2-dfdebdef0a22 service nova] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_rules [ 1015.178558] env[67003]: INFO networking_nsxv3.common.synchronization [req-39d78865-0b5d-4049-b221-0e6a0652fc04 req-0db44e34-1f10-4f5c-b7a2-dfdebdef0a22 service nova] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1015.178558] env[67003]: INFO networking_nsxv3.common.synchronization [req-39d78865-0b5d-4049-b221-0e6a0652fc04 req-0db44e34-1f10-4f5c-b7a2-dfdebdef0a22 service nova] Enqueued Resource ID: b049119f-a97a-4bad-b45d-92fb699c27f2 with Priority: HIGHEST for action port [ 1015.179918] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_rules [ 1015.180192] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1015.180492] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b049119f-a97a-4bad-b45d-92fb699c27f2 with Priority: HIGHEST for action port [ 1015.180656] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.181088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.181088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.181088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.181226] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.182980] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.182980] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.183570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.183615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.184241] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.184522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.184593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.185059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.185059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.185059] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.186264] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b049119f-a97a-4bad-b45d-92fb699c27f2 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.186407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b049119f-a97a-4bad-b45d-92fb699c27f2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.186537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b049119f-a97a-4bad-b45d-92fb699c27f2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.186651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b049119f-a97a-4bad-b45d-92fb699c27f2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.186731] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b049119f-a97a-4bad-b45d-92fb699c27f2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.404142] env[67003]: INFO networking_nsxv3.common.synchronization [req-b52e854d-b871-4b91-8428-b0e8c41b43a1 req-b5b59c94-c8cc-4c50-8564-e704fddc776d tempest-ServerActionsV293TestJSON-1797352496 tempest-ServerActionsV293TestJSON-1797352496-project-member] Enqueued Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGHEST for action security_group_members [ 1015.405071] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGHEST for action security_group_members [ 1015.405165] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.406050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.406050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.406050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.406050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.406050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.406050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.406050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.406407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.406407] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.592026] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ac5d0186-3918-4fee-aaf4-b2a10d31eb1b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.683107] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.683353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.689784] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b049119f-a97a-4bad-b45d-92fb699c27f2 with status ACTIVE [ 1015.690164] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.690359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.690359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.690637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.690637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.690827] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.690953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.691036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.691250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.691331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.691520] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.691627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.691688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.691825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.691896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.692110] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b049119f-a97a-4bad-b45d-92fb699c27f2 is going to be updated. [ 1015.693093] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.719184] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.719417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.719526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.719841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.720078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.720345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b049119f-a97a-4bad-b45d-92fb699c27f2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.736011] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-800 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.736484] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-800" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.736719] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-800" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.737226] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-800" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.737620] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.737886] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.738143] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.738518] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.738795] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.739169] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.739381] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1015.739587] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1015.739799] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1015.740037] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1015.740257] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1015.740487] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1015.797064] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1015.797321] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.057 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1015.797451] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1015.797574] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-800" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.797899] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-d9e0ca09-b21b-48e5-b38b-f64b17b38852 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.798110] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-d9e0ca09-b21b-48e5-b38b-f64b17b38852" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.798184] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-d9e0ca09-b21b-48e5-b38b-f64b17b38852" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.798515] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-d9e0ca09-b21b-48e5-b38b-f64b17b38852" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.798649] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9e0ca09-b21b-48e5-b38b-f64b17b38852',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.809027] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 in Status: SUCCESS [ 1015.809202] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 deletion is rescheduled due to dependency. [ 1015.809315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.909056] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.909220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.909481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.909722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.909816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.910034] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.910142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.910206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.910371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.910459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.910553] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a already deleted. [ 1015.910636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.094195] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.094428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.094428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.094540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.094710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.094795] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b is going to be created. [ 1016.124129] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.124356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.124413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.124619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.124781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.134128] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b in Status: UNINITIALIZED for 2s [ 1016.195669] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.301800] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.302090] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.302192] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.302456] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.302608] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.302840] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port d9e0ca09-b21b-48e5-b38b-f64b17b38852 not found, creating... [ 1016.303027] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.303188] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.303304] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.303538] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.303718] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.304067] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.304284] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.304418] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.304659] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.304789] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.304903] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: d9e0ca09-b21b-48e5-b38b-f64b17b38852 is going to be created. [ 1016.325947] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.326213] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.326415] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.326698] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.326939] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.327229] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-d9e0ca09-b21b-48e5-b38b-f64b17b38852" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.698262] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.698262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.698389] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.698635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.698744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.698838] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be updated. [ 1016.731729] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.731925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.732034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.732305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.732628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.748157] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: IN_PROGRESS for 2s [ 1017.047386] env[67003]: INFO networking_nsxv3.common.synchronization [req-b52e854d-b871-4b91-8428-b0e8c41b43a1 req-67a4e883-549b-432b-9a19-48e24a0e016f service nova] Enqueued Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGHEST for action security_group_rules [ 1017.047386] env[67003]: INFO networking_nsxv3.common.synchronization [req-b52e854d-b871-4b91-8428-b0e8c41b43a1 req-67a4e883-549b-432b-9a19-48e24a0e016f service nova] Enqueued Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGHEST for action security_group_members [ 1017.047386] env[67003]: INFO networking_nsxv3.common.synchronization [req-b52e854d-b871-4b91-8428-b0e8c41b43a1 req-67a4e883-549b-432b-9a19-48e24a0e016f service nova] Enqueued Resource ID: d9e0ca09-b21b-48e5-b38b-f64b17b38852 with Priority: HIGHEST for action port [ 1017.047386] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGHEST for action security_group_rules [ 1017.050540] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGHEST for action security_group_members [ 1017.050540] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9e0ca09-b21b-48e5-b38b-f64b17b38852 with Priority: HIGHEST for action port [ 1017.050540] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.050540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.050540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.050540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.050540] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.050540] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.050540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.050540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.050540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.050540] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.050540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.050540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.051540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.051755] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.052075] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.052955] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9e0ca09-b21b-48e5-b38b-f64b17b38852 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.055877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9e0ca09-b21b-48e5-b38b-f64b17b38852" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.055877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9e0ca09-b21b-48e5-b38b-f64b17b38852" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.055877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9e0ca09-b21b-48e5-b38b-f64b17b38852" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.055877] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9e0ca09-b21b-48e5-b38b-f64b17b38852',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.559022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.559022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.559022] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.559022] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9e0ca09-b21b-48e5-b38b-f64b17b38852 with status ACTIVE [ 1017.559022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.561206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.561206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.561206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.561206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.561206] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.561206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.561206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.561206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.561206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.561864] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.561864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.561864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.561864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.561864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.561864] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9e0ca09-b21b-48e5-b38b-f64b17b38852 is going to be updated. [ 1017.583552] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.583739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.583808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.583969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.584123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.584282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9e0ca09-b21b-48e5-b38b-f64b17b38852" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.064931] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.151495] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b in Status: SUCCESS [ 1018.151977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.152117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.152406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.152752] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.152876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.152979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.153289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.153381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.153508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.153643] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ac5d0186-3918-4fee-aaf4-b2a10d31eb1b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.568881] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.568881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.568881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.569358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.569358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.569424] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a is going to be created. [ 1018.601820] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.602144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.602144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.602422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.602637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.613566] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a in Status: UNINITIALIZED for 2s [ 1018.656208] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.656467] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.656533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.656733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.656909] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.657019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.657077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.657256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.657370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.657461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.657632] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.657726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.657784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.657945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.658104] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.658200] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.658259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.658409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.658486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.658583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.658692] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ac5d0186-3918-4fee-aaf4-b2a10d31eb1b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.764620] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 1018.764949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.765238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.765501] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.765715] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.765845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.765913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.766073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.766185] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.766309] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.766430] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.161544] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ac5d0186-3918-4fee-aaf4-b2a10d31eb1b: rpc.has_security_group_logging(os_id): False [ 1019.181246] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.181481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.181588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.181908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.182062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.182372] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.182520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.182615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.182847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.182968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.183291] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.183436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.183536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.183863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.183981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.184199] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.184345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.184541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.184672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.184774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.184905] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b is going to be created. [ 1019.248324] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.248489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.248558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.248826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.249067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.261263] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b in Status: IN_PROGRESS for 2s [ 1019.268871] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.269122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.269249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.269685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.269776] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.269861] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.269939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.270125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.270212] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.270301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.270458] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.270553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.270612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.270754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.270889] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.270981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.271077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.271218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.271292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.271376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.271467] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.773756] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a: rpc.has_security_group_logging(os_id): False [ 1019.792674] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.792914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.792914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.793119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.793252] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.793434] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.793539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.793601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.793771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.793858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.794059] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.794185] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.794306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.794472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.794546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.794726] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.794820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.794880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.795023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.795099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.795184] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be updated. [ 1019.869767] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.869991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.869991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.870226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.870403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.883776] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: IN_PROGRESS for 2s [ 1020.625697] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a in Status: SUCCESS [ 1020.625907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.626092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.626458] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.626514] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.626626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.626814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.627014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.627104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.627267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.627305] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.700377] env[67003]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1020.700603] env[67003]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] NSXv3 Agent Agent loop - iteration:2 started [ 1021.133474] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.274860] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b in Status: SUCCESS [ 1021.275100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.637032] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a: rpc.has_security_group_logging(os_id): False [ 1021.655659] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.655807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.655878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.656112] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.656200] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.656550] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.656669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.656764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.656930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.657031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.657159] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a is going to be created. [ 1021.744552] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.744765] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.744807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.745243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.745365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.768823] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a in Status: IN_PROGRESS for 2s [ 1021.903757] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 1021.904168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.049511] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1022.049769] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1022.177841] env[67003]: INFO networking_nsxv3.common.synchronization [req-87de80a0-5a37-4436-9350-f0eae00f2a32 req-c978d220-7ed4-463a-9ab6-303bb9dafdf0 tempest-DeleteServersTestJSON-1342989894 tempest-DeleteServersTestJSON-1342989894-project-member] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1022.179048] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1022.179048] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.179245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.179245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.179582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.179758] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.179918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.179980] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.180159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.180245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.180340] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.484299] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-521 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.484491] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.484676] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.484942] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.485407] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.485584] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.485704] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.486221] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.486221] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.486343] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.486428] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.486536] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.486646] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.486757] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.486863] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.486992] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.507940] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.508154] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1022.508298] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.508481] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.508889] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-3b479f27-2b34-4ade-bf75-477fc388c029 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.509089] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-3b479f27-2b34-4ade-bf75-477fc388c029" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.509220] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-3b479f27-2b34-4ade-bf75-477fc388c029" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.509591] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-3b479f27-2b34-4ade-bf75-477fc388c029" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.509713] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b479f27-2b34-4ade-bf75-477fc388c029',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.686027] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.686027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.686027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.686027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.686027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.686027] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.686027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.686027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.686027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.686027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.686027] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1022.717037] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.717037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.717037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.717037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.717037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.729782] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1023.014954] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.014954] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.014954] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.014954] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.014954] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.014954] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 3b479f27-2b34-4ade-bf75-477fc388c029 not found, creating... [ 1023.014954] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.014954] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.015564] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.015564] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.015564] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.015829] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.016118] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.016297] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.016571] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.016735] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.016982] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 3b479f27-2b34-4ade-bf75-477fc388c029 is going to be created. [ 1023.040471] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.040800] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.040977] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.041336] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.041612] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.041858] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-3b479f27-2b34-4ade-bf75-477fc388c029" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.733441] env[67003]: INFO networking_nsxv3.common.synchronization [req-87de80a0-5a37-4436-9350-f0eae00f2a32 req-eab314b1-cfe9-46c6-a612-10e060bedfcc service nova] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_rules [ 1023.733832] env[67003]: INFO networking_nsxv3.common.synchronization [req-87de80a0-5a37-4436-9350-f0eae00f2a32 req-eab314b1-cfe9-46c6-a612-10e060bedfcc service nova] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1023.733832] env[67003]: INFO networking_nsxv3.common.synchronization [req-87de80a0-5a37-4436-9350-f0eae00f2a32 req-eab314b1-cfe9-46c6-a612-10e060bedfcc service nova] Enqueued Resource ID: 3b479f27-2b34-4ade-bf75-477fc388c029 with Priority: HIGHEST for action port [ 1023.734406] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_rules [ 1023.734482] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1023.734542] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3b479f27-2b34-4ade-bf75-477fc388c029 with Priority: HIGHEST for action port [ 1023.734802] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.734938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.735025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.735188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.735282] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.736090] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.736209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.736399] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-3b479f27-2b34-4ade-bf75-477fc388c029 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.736530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3b479f27-2b34-4ade-bf75-477fc388c029" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.736604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3b479f27-2b34-4ade-bf75-477fc388c029" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.736725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3b479f27-2b34-4ade-bf75-477fc388c029" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.736799] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3b479f27-2b34-4ade-bf75-477fc388c029',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.785462] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a in Status: SUCCESS [ 1023.785671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.238232] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.238393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.239747] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3b479f27-2b34-4ade-bf75-477fc388c029 with status ACTIVE [ 1024.240332] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.240332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.240466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.240681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.240789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.241014] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.241128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.241192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.241358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.241439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.241647] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.241765] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.241828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.241985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.242084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.242305] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3b479f27-2b34-4ade-bf75-477fc388c029 is going to be updated. [ 1024.265195] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.265393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.265459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.265765] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.265968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.266329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3b479f27-2b34-4ade-bf75-477fc388c029" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.635803] env[67003]: INFO networking_nsxv3.common.synchronization [req-35545e58-3f95-4b01-a469-c58d95065b89 req-58141201-c5ee-4c43-99fb-39b171086554 tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1024.637201] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1024.637201] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.637201] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.637201] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.637201] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.637487] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.637487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.637571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.637718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.637803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.637901] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.741690] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1024.742110] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 deletion is rescheduled due to dependency. [ 1024.742330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.742529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.742949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.743110] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.743262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.743377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.743515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.743628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.743732] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.028502] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.028802] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.028940] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.029310] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.029637] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.029857] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.030017] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.030308] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.030475] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.030799] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.030977] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1025.031155] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1025.031284] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1025.031412] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1025.031529] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1025.031695] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1025.052466] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1025.052645] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1025.052809] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1025.053008] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.053355] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-5d6a97e4-82d0-4338-b521-118b28fa5caf taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.053817] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-5d6a97e4-82d0-4338-b521-118b28fa5caf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.053817] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-5d6a97e4-82d0-4338-b521-118b28fa5caf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.054043] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-5d6a97e4-82d0-4338-b521-118b28fa5caf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.054184] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d6a97e4-82d0-4338-b521-118b28fa5caf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.139564] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.139736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.139828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.140098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.140198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.140395] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.140494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.140560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.140710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.140785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.140867] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d already deleted. [ 1025.140947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.248193] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.557400] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.558200] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.558200] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.558200] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.558830] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.558830] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 5d6a97e4-82d0-4338-b521-118b28fa5caf not found, creating... [ 1025.558830] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.559028] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.559125] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.559498] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.559561] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.559955] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.560096] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.560245] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.560495] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.560662] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.560847] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 5d6a97e4-82d0-4338-b521-118b28fa5caf is going to be created. [ 1025.584543] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.584543] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.584543] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.584543] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.584543] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.584543] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-5d6a97e4-82d0-4338-b521-118b28fa5caf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.750543] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.207896] env[67003]: INFO networking_nsxv3.common.synchronization [req-d4cd89c0-9782-4fa6-97bd-9897293b6be6 req-3fea8140-60e1-4c64-b024-b0c6e1b82f3a tempest-ImagesNegativeTestJSON-104515178 tempest-ImagesNegativeTestJSON-104515178-project-member] Enqueued Resource ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b with Priority: HIGHEST for action security_group_members [ 1026.208459] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b with Priority: HIGHEST for action security_group_members [ 1026.208771] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.208907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.208952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.209184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.209530] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.209530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.209530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.209681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.209789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.209844] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ac5d0186-3918-4fee-aaf4-b2a10d31eb1b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.253276] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.253419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.253493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.253704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.253792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.253890] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1026.281520] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.281520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.281520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.281660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.281755] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.285338] env[67003]: INFO networking_nsxv3.common.synchronization [req-35545e58-3f95-4b01-a469-c58d95065b89 req-f89260e5-5280-4280-90c8-b860665afcb6 service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1026.285551] env[67003]: INFO networking_nsxv3.common.synchronization [req-35545e58-3f95-4b01-a469-c58d95065b89 req-f89260e5-5280-4280-90c8-b860665afcb6 service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1026.285783] env[67003]: INFO networking_nsxv3.common.synchronization [req-35545e58-3f95-4b01-a469-c58d95065b89 req-f89260e5-5280-4280-90c8-b860665afcb6 service nova] Enqueued Resource ID: 5d6a97e4-82d0-4338-b521-118b28fa5caf with Priority: HIGHEST for action port [ 1026.286397] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1026.286525] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1026.286655] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d6a97e4-82d0-4338-b521-118b28fa5caf with Priority: HIGHEST for action port [ 1026.287026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.287202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.287420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.287770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.288501] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.288834] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.290031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.290031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.290031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.290031] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.290031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.290277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.290277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.290337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.290442] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.291874] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d6a97e4-82d0-4338-b521-118b28fa5caf taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.291874] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d6a97e4-82d0-4338-b521-118b28fa5caf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.291874] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d6a97e4-82d0-4338-b521-118b28fa5caf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.291874] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d6a97e4-82d0-4338-b521-118b28fa5caf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.291874] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d6a97e4-82d0-4338-b521-118b28fa5caf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.293707] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1026.715026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.715026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.715026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.715026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.715026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.715026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.715026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.715026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.715026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.715026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.715026] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b is going to be updated. [ 1026.752040] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.752040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.752040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.752040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.752040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.775699] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b in Status: IN_PROGRESS for 2s [ 1026.793577] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.793761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.799354] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.800294] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d6a97e4-82d0-4338-b521-118b28fa5caf with status ACTIVE [ 1026.800517] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.800646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.800705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.800952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.801039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.801193] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.801333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.801375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.801620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.801620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.801834] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.801953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.802026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.802196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.802277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.802357] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d6a97e4-82d0-4338-b521-118b28fa5caf is going to be updated. [ 1026.832496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.832646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.832717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.832939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.833110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.833270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d6a97e4-82d0-4338-b521-118b28fa5caf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.305255] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.809470] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.809885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.809885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.809998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.810063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.810137] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be created. [ 1027.836239] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.836474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.836543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.836776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.836934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.846691] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: UNINITIALIZED for 2s [ 1028.179502] env[67003]: INFO networking_nsxv3.common.synchronization [req-9fba1e50-7167-4786-874f-a4b35d627cb4 req-73ea3ebe-39b1-4010-ab1d-806783b2fd83 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1028.180073] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1028.180545] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.180713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.180814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.181107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.181328] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.181474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.181571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.181792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.181921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.182087] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.305452] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1028.305684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.305862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.306105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.306403] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.306512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.306576] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.306745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.306825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.306909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.306995] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.684974] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.787806] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b in Status: SUCCESS [ 1028.787993] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b deletion is rescheduled due to dependency. [ 1028.788130] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.810223] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.810763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.810763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.810942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.811175] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.811318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.811411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.811853] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.811962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.812109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.812297] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.812393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.812452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.812664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.812816] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.812910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.812966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.813124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.813203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.813287] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.813378] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.188910] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.316686] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06d182ef-21b7-44fd-8cbf-2f35f7927435: rpc.has_security_group_logging(os_id): False [ 1029.336260] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.336490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.336558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.336736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.336870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.337050] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.337144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.337207] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.337407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.337407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.337595] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.337684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.337745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.337880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.337951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.338150] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.338248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.338313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.338430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.338504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.338587] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1029.400184] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.400354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.400418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.400660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.400982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.407597] env[67003]: INFO networking_nsxv3.common.synchronization [None req-301a2d77-7cd9-464f-9d23-bae7d8047e42 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1029.408159] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1029.408555] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.408663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.418027] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1029.691584] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.691584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.691584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.691584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.691584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.691584] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be updated. [ 1029.733350] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.733493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.733624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.733769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.733919] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.745749] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: IN_PROGRESS for 2s [ 1029.858716] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1029.859101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.859307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.859568] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.859817] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.859946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.860020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.860698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.860698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.861064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.861064] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.364029] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.364029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.364029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.364322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.364322] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.364446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.364512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.364669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.364756] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.364846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.365107] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.365107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.365255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.365299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.365443] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.365535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.365596] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.365902] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.366113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.366239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.366392] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.870702] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f76f58af-f507-4428-b198-11ce6caf814d: rpc.has_security_group_logging(os_id): False [ 1030.889861] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.890486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.892020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.892020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.892020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.892020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.892020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.892020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.892020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.899559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.899559] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.899559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.899559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.899559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.899559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.899559] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.899559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.899559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.899559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.899559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.899559] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be created. [ 1030.960800] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.960800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.960800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.961129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.961129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.991155] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1031.435013] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1031.435359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.762490] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 1031.762897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.763825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.763825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.764075] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.764075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.764183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.764364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.764466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.764648] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.267147] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.267662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.267662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.267662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.267809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.268305] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.268305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.268305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.268305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.268535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.268535] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be updated. [ 1032.300591] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.300956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.301018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.301374] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.301451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.311567] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: IN_PROGRESS for 2s [ 1032.608123] env[67003]: INFO networking_nsxv3.common.synchronization [req-b32f5efe-09a5-4123-9ef7-abd0116f9801 req-c0f1330e-645f-4d3e-9451-58d65195f00d tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGHEST for action security_group_members [ 1032.608966] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGHEST for action security_group_members [ 1032.609672] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f2e25f5a-d04c-463f-a7f6-17866b02d583 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.609672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.609672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.609926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.610089] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.610196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.610314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.611119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.611119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.611119] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f2e25f5a-d04c-463f-a7f6-17866b02d583',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.648590] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.648847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.648918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.649245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.649370] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.005998] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1033.006239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.115382] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.115583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.115583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.115810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.139415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.139760] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.139880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.139946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.140166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.140246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.140338] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 is going to be updated. [ 1033.152091] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.180029] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.180029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.180029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.180029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.180029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.193156] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 in Status: IN_PROGRESS for 2s [ 1033.653894] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.156526] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1034.156763] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1034.323706] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 1034.324184] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a deletion is rescheduled due to dependency. [ 1034.324307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.873395] env[67003]: INFO networking_nsxv3.common.synchronization [req-26c51167-2a62-459f-a10a-b85e7da55a66 req-b55e2081-f948-4989-bd90-6574c11d716a tempest-ServerDiskConfigTestJSON-448903628 tempest-ServerDiskConfigTestJSON-448903628-project-member] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 1034.873977] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 1034.874393] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.874547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.874632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.874899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.875112] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.875195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.876411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.876411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.876411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.876411] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.176028] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.176213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.176261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.176648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.188325] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1035.190994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.192887] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1035.203664] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 in Status: SUCCESS [ 1035.203840] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 deletion is rescheduled due to dependency. [ 1035.203949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.231453] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.231453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.231453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.231453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.241161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.241932] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1035.242034] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1035.242138] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1035.283845] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.284058] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.284058] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.284269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.285670] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.285970] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1035.361429] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.361429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.361429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.361618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.361910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.362204] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1035.377970] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.378195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.378262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.378512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.400575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.400858] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.401566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.401711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.401946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.402049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.402365] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 1035.435407] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.435407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.435407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.435407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.435407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.442918] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 1035.453338] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.453338] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.453338] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.453338] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.453338] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.453338] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:46. [ 1035.453338] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'24c47389-894a-46a4-ac4e-16c5bd995856', '94cc9917-b413-4c1b-9c52-44b1bbb1141a', '00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a', '11ed018b-2f29-4f20-913e-d07a9663638e', '33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a', '4cad76eb-924a-41f1-b865-f281dc96cec6', 'd9af6be1-7f4c-49d6-8fab-b97bada50e98', 'a4863374-5c9e-490a-be11-1eac203337f7', 'c06f8726-ef82-4058-ad8d-7e0aabd079e1', '3cb3702a-8afa-4d0e-bd1f-17a5225e0319', '06d182ef-21b7-44fd-8cbf-2f35f7927435', '993ce117-521f-4677-9ad6-2a219a7366c9', '0984692d-32cd-4b7f-9bd0-7496ca581278', 'ac5d0186-3918-4fee-aaf4-b2a10d31eb1b', '3cc0841b-286c-4904-bf0d-135e41f2566e', 'dc04636e-53f4-4929-8ae4-d13a910a1d84', '745fb2b7-cb25-4398-b51d-8a61982bb1ed', 'f76f58af-f507-4428-b198-11ce6caf814d', '88eb58df-f15b-48e8-baa4-7b64e596d069', 'aecf3eb9-1ca3-4c5d-973b-4e11d36881cc', 'd622b8c0-157c-4b92-b9e3-c2d6c4c2793b', 'dba32874-38b5-4411-a3c9-effdd63d65c0', 'a47e002a-325f-4303-8dea-86209028ebb0', '55872268-81d2-4523-87e7-e00ce5194127', '55815927-bbca-4dbc-be18-77001e3e9c6b', 'e316a4c0-3a83-4827-a5c7-8cc4a342b65d', 'ea11303f-c0fb-4922-8c26-9eb29fdbf672', '00a6980b-e22e-4c0a-a83a-f2c84907f57a', '64b82baf-96b3-4d2a-a0f3-634fd5e24137', 'aa8a0a38-37aa-4674-acd4-bfc56f11a31e', '4ec9467a-c24b-4be1-ba5a-173726e27cfc', '4ca7593b-6cf9-418e-9d37-bb09b986e001', '9f930f78-bc74-4f34-9558-0ffb6faee5ec', 'a279ae9a-5f5b-4b3f-a403-fcef8683474d', '032f92e2-50d8-4e5f-901e-8c80dbcfbdf5', '25f0058d-8729-4623-a291-7d3376597063', '09ad0af4-47bb-47f8-a343-07c0b9be11a8', '879b3713-7487-492d-b6e1-77747451fce3', 'f2e25f5a-d04c-463f-a7f6-17866b02d583', '716cf816-3048-4122-8676-0137157fed0e', 'b1fb9da3-caa0-493e-935e-25393509c210', 'd9485466-865a-4183-ac2a-0720f6740f8a', '7a631474-f774-4747-8676-6477b61cae29', 'ea05aafd-d89a-4a4a-8f6a-25194a42d3e1', 'eda6bee5-9b5c-4b6f-888f-231f9c7282b1', 'c7f76d7e-ac8b-403e-8138-5cfc21622e31'} {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1035.453338] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1035.475431] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.475431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.475431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.475431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.475431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.475431] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1035.475431] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1035.475431] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1035.565971] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.570013] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.570107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.570344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.572206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.572548] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1035.572598] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1035.572645] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1035.572711] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1035.572791] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/46 resources of Type:Security Group Rules [ 1035.572862] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGH for action security_group_rules [ 1035.572941] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGH for action security_group_rules [ 1035.573017] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGH for action security_group_rules [ 1035.573104] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGH for action security_group_rules [ 1035.573148] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGH for action security_group_rules [ 1035.573201] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGH for action security_group_rules [ 1035.573262] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 with Priority: HIGH for action security_group_rules [ 1035.573354] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGH for action security_group_rules [ 1035.573390] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGH for action security_group_rules [ 1035.573474] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 with Priority: HIGH for action security_group_rules [ 1035.573549] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGH for action security_group_rules [ 1035.573611] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGH for action security_group_rules [ 1035.574212] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGH for action security_group_rules [ 1035.574331] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b with Priority: HIGH for action security_group_rules [ 1035.574438] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGH for action security_group_rules [ 1035.574518] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGH for action security_group_rules [ 1035.574587] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGH for action security_group_rules [ 1035.574658] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGH for action security_group_rules [ 1035.574724] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGH for action security_group_rules [ 1035.574789] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGH for action security_group_rules [ 1035.574887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.454508] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 1037.454891] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 deletion is rescheduled due to dependency. [ 1037.454891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.505529] env[67003]: INFO networking_nsxv3.common.synchronization [None req-972f565d-9d5a-4361-b961-03933a1ff8bd tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_rules [ 1039.506759] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_rules [ 1039.506759] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24c47389-894a-46a4-ac4e-16c5bd995856 with Priority: HIGH for action security_group_rules [ 1039.506922] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGH for action security_group_rules [ 1039.506958] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 with Priority: HIGH for action security_group_rules [ 1039.507254] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cc0841b-286c-4904-bf0d-135e41f2566e with Priority: HIGH for action security_group_rules [ 1039.507373] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc with Priority: HIGH for action security_group_rules [ 1039.507471] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGH for action security_group_rules [ 1039.507603] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGH for action security_group_rules [ 1039.508031] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGH for action security_group_rules [ 1039.508031] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b with Priority: HIGH for action security_group_rules [ 1039.508181] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 with Priority: HIGH for action security_group_rules [ 1039.508300] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 with Priority: HIGH for action security_group_rules [ 1039.508566] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGH for action security_group_rules [ 1039.508566] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGH for action security_group_rules [ 1039.508964] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 with Priority: HIGH for action security_group_rules [ 1039.508964] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 with Priority: HIGH for action security_group_rules [ 1039.509187] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGH for action security_group_rules [ 1039.509262] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a4863374-5c9e-490a-be11-1eac203337f7 with Priority: HIGH for action security_group_rules [ 1039.509499] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGH for action security_group_rules [ 1039.509618] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a with Priority: HIGH for action security_group_rules [ 1039.509786] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11ed018b-2f29-4f20-913e-d07a9663638e with Priority: HIGH for action security_group_rules [ 1039.510270] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.510578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.510676] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.511096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.511223] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.513279] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-24c47389-894a-46a4-ac4e-16c5bd995856 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.513478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.513603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.513900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.514201] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('24c47389-894a-46a4-ac4e-16c5bd995856',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.515242] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.516169] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.516291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.516618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.516709] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.519620] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9af6be1-7f4c-49d6-8fab-b97bada50e98 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.519620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.519620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.520088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.520088] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9af6be1-7f4c-49d6-8fab-b97bada50e98',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.522676] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cc0841b-286c-4904-bf0d-135e41f2566e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.522947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.522998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.523290] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.523426] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cc0841b-286c-4904-bf0d-135e41f2566e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.525422] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.526441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.526441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.526441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.526602] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aecf3eb9-1ca3-4c5d-973b-4e11d36881cc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.527764] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.528551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.528551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.528551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.528551] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.529680] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.529994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.529994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.531267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.531407] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.534513] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.534513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.534513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.534823] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.535167] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.537299] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.537693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.537693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.537944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.538776] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ac5d0186-3918-4fee-aaf4-b2a10d31eb1b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.540981] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc04636e-53f4-4929-8ae4-d13a910a1d84 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.541196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.541301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.541558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.541686] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc04636e-53f4-4929-8ae4-d13a910a1d84',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.545710] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0984692d-32cd-4b7f-9bd0-7496ca581278 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.546320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.546320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.546320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.546494] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0984692d-32cd-4b7f-9bd0-7496ca581278',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.548447] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-993ce117-521f-4677-9ad6-2a219a7366c9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.548643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.548761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.550036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.550036] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.551408] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.552078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.552078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.552078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.552208] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.554734] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3cb3702a-8afa-4d0e-bd1f-17a5225e0319 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.554848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.554885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.555564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.555564] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3cb3702a-8afa-4d0e-bd1f-17a5225e0319',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.556445] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.556659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.556853] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.557656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.557763] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c06f8726-ef82-4058-ad8d-7e0aabd079e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.559652] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cad76eb-924a-41f1-b865-f281dc96cec6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.559829] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.559942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.560497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.561081] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.562240] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a4863374-5c9e-490a-be11-1eac203337f7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.562443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.562565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.562884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.563146] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a4863374-5c9e-490a-be11-1eac203337f7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.565183] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.565183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.565183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.565372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.565405] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.567251] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.567592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.567592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.567986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.568428] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('94cc9917-b413-4c1b-9c52-44b1bbb1141a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.569527] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-11ed018b-2f29-4f20-913e-d07a9663638e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.569527] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.569527] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.570092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.570092] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('11ed018b-2f29-4f20-913e-d07a9663638e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.710435] env[67003]: INFO networking_nsxv3.common.synchronization [None req-311b71c6-3f53-4643-b63b-cc27f35f4815 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_rules [ 1039.710983] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_rules [ 1039.711337] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.711477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.727996] env[67003]: INFO networking_nsxv3.common.synchronization [req-0e6962ce-45cd-479e-a3b4-2e45f7dbb30f req-ee316f57-bacf-41ec-884f-7b335179dfac tempest-DeleteServersTestJSON-1342989894 tempest-DeleteServersTestJSON-1342989894-project-member] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1039.728619] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1039.728975] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.729153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.729251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.729511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.729659] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.729768] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.729845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.730044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.730176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.730307] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.022020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.022020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.022020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.022020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.022020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.022020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.022020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.022020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.022020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.022020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.022020] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.035810] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.035810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.035810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.035810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.035810] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.037472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.037472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.037672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.037765] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.037850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.037939] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.043546] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.043742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.043742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.043909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.043948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.044044] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 already deleted. [ 1040.044126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.046802] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.046802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.046802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.046802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.047516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.047686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.047778] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.055263] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.055263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.065028] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cad76eb-924a-41f1-b865-f281dc96cec6 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.065385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.065385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.065385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.065563] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.066083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.066183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.066356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.066472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.066565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.066686] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.073030] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.073197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.075956] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-993ce117-521f-4677-9ad6-2a219a7366c9 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.076144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.076192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.076359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.076552] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.076665] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.076771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.076871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.076956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.077056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.077165] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.082555] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.082662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.082734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.083026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.083026] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.083219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.083293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.083442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.083508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.083596] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.083680] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.091284] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.091439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.096759] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.096884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.098057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.098057] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9af6be1-7f4c-49d6-8fab-b97bada50e98 is going to be deleted. [ 1040.100786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.101936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.129814] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.130363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.131606] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.131767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.132690] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.132876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.133842] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.133986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.136228] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.136228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.139613] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.139613] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.139613] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.139613] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.139613] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.139613] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.139940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.139940] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc04636e-53f4-4929-8ae4-d13a910a1d84 is going to be deleted. [ 1040.141815] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.142177] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.144768] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.144768] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.146679] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.149282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.203472] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.203629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.206971] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1040.207586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.207740] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ac5d0186-3918-4fee-aaf4-b2a10d31eb1b is going to be deleted. [ 1040.210524] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.210524] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.231660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.231878] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0984692d-32cd-4b7f-9bd0-7496ca581278 is going to be deleted. [ 1040.233022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.233107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.233167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.233360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.256663] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.256663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.287190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.287190] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.287190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.287190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.287190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.287190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.287190] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1040.287837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.288522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.339136] env[67003]: INFO networking_nsxv3.common.synchronization [None req-387900b5-6c96-4378-aa11-16ebe44253ad None None] Enqueued Resource ID: 2eae9fb7-4aaa-4cc8-84ae-9632177921b1 with Priority: HIGHEST for action port [ 1040.339136] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2eae9fb7-4aaa-4cc8-84ae-9632177921b1 with Priority: HIGHEST for action port [ 1040.339136] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2eae9fb7-4aaa-4cc8-84ae-9632177921b1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.339136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2eae9fb7-4aaa-4cc8-84ae-9632177921b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.339136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2eae9fb7-4aaa-4cc8-84ae-9632177921b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.339793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2eae9fb7-4aaa-4cc8-84ae-9632177921b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.339991] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2eae9fb7-4aaa-4cc8-84ae-9632177921b1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.345077] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.345077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.345077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.345503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.345503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.353033] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.353033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.355039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.355039] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c06f8726-ef82-4058-ad8d-7e0aabd079e1 is going to be deleted. [ 1040.356086] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.356350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.356574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.356876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.357091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.357313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0984692d-32cd-4b7f-9bd0-7496ca581278" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.357581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.359024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.366290] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1040.429914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.430418] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be deleted. [ 1040.431732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.431964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.523599] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.533876] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.534183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.540679] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.541020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.541020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.541214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.541389] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.541497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.541562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.541825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.541825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.541923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.542062] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.542147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.542196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.542323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.542458] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.542550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.542610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.542742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.542826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.542903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.543014] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.551606] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.551707] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 94cc9917-b413-4c1b-9c52-44b1bbb1141a is going to be deleted. [ 1040.553061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.553361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.569470] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.579488] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.585541] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.585750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.585849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.586184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.586453] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.586529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.586626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.586782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.586981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.587070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.587281] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.587412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.587503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.587707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.587928] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.590636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.590833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.591150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.591417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.591535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.591722] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.610958] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.611091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.613206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.613348] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed is going to be deleted. [ 1040.614517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.614744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.616534] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.616668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.657162] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.657162] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cb3702a-8afa-4d0e-bd1f-17a5225e0319 is going to be deleted. [ 1040.657162] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.657162] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.689729] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.689897] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aecf3eb9-1ca3-4c5d-973b-4e11d36881cc is going to be deleted. [ 1040.691544] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.691666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.691737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.691957] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.693571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.696342] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-94cc9917-b413-4c1b-9c52-44b1bbb1141a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.696342] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.696342] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.782952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.782952] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 24c47389-894a-46a4-ac4e-16c5bd995856 is going to be deleted. [ 1040.783898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.784215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.784281] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.784378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9af6be1-7f4c-49d6-8fab-b97bada50e98" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.784554] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.784720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.844508] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2eae9fb7-4aaa-4cc8-84ae-9632177921b1 [ 1040.844508] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.844508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.844508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.844814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.844814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.844884] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2eae9fb7-4aaa-4cc8-84ae-9632177921b1 already deleted. [ 1040.844992] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2eae9fb7-4aaa-4cc8-84ae-9632177921b1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.848973] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.849285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.857043] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.858667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.861170] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.861170] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 11ed018b-2f29-4f20-913e-d07a9663638e is going to be deleted. [ 1040.862238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.862520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.862608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.862726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc04636e-53f4-4929-8ae4-d13a910a1d84" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.862863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.863491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.863491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.863491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ac5d0186-3918-4fee-aaf4-b2a10d31eb1b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.864550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.864550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.929892] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.930034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.949155] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.949353] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a4863374-5c9e-490a-be11-1eac203337f7 is going to be deleted. [ 1040.950541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.950541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.950541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.950746] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c06f8726-ef82-4058-ad8d-7e0aabd079e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.950799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.950942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.951027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.951338] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 already deleted. [ 1040.951338] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.951759] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.951919] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.951998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.952532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.952532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.952659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.007833] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.008065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.012862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.013045] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3cc0841b-286c-4904-bf0d-135e41f2566e is going to be deleted. [ 1041.014231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.015048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.015048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.015048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.015333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.015581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.015714] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.015876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cb3702a-8afa-4d0e-bd1f-17a5225e0319" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.016592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.017127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.017127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.017127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aecf3eb9-1ca3-4c5d-973b-4e11d36881cc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.017271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.017444] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.017587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.017699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-24c47389-894a-46a4-ac4e-16c5bd995856" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.026294] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a: rpc.has_security_group_logging(os_id): False [ 1041.048423] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f76f58af-f507-4428-b198-11ce6caf814d: rpc.has_security_group_logging(os_id): False [ 1041.072383] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4cad76eb-924a-41f1-b865-f281dc96cec6: rpc.has_security_group_logging(os_id): False [ 1041.081380] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.081380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.081380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.082073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.084947] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 993ce117-521f-4677-9ad6-2a219a7366c9: rpc.has_security_group_logging(os_id): False [ 1041.084947] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.085317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.095551] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 88eb58df-f15b-48e8-baa4-7b64e596d069: rpc.has_security_group_logging(os_id): False [ 1041.122156] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.122361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.132402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.132920] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.132920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.132920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.133177] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.134605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.134605] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.134605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.134605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.134605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.134605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.134605] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.134605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.134605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.134605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.134605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.134605] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1041.136042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.136042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.148678] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.148878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.149787] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.149944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.150680] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.150943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.172140] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.172710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.176804] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.177055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.247125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.247451] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.247615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.247709] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.247892] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.248031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.248241] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a is going to be updated. [ 1041.250133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.250433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.250508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.250635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-11ed018b-2f29-4f20-913e-d07a9663638e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.250820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.251044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.251150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.251274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3cc0841b-286c-4904-bf0d-135e41f2566e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.251424] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.251571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.281378] env[67003]: INFO networking_nsxv3.common.synchronization [None req-0b6dfe25-e7fa-4612-9751-7b53b9b21307 tempest-AttachInterfacesUnderV243Test-564471411 tempest-AttachInterfacesUnderV243Test-564471411-project-member] Enqueued Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_rules [ 1041.282010] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_rules [ 1041.282337] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.282528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.282580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.282966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.282966] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.305707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.306175] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.306175] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.306362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.306486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.306591] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.306840] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.306947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.307022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.307264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.307264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.307480] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.307541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.307597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.307745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.307833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.307929] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 is going to be updated. [ 1041.309409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.309592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.362010] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.362176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.393786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.394679] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.394679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.394679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.394679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.394679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.394989] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 993ce117-521f-4677-9ad6-2a219a7366c9 is going to be updated. [ 1041.395867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.398236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.401922] env[67003]: INFO networking_nsxv3.common.synchronization [None req-1aec526a-3393-4d2a-a383-8c75ddbebba1 tempest-AttachInterfacesUnderV243Test-564471411 tempest-AttachInterfacesUnderV243Test-564471411-project-member] Enqueued Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_rules [ 1041.403453] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_rules [ 1041.403819] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.403930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.463636] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.463636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.467098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.469032] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.469032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.469032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.469032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.469032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.469032] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 is going to be updated. [ 1041.470657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.471156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.471460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.473493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.473493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.473493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.473493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a4863374-5c9e-490a-be11-1eac203337f7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.474250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.474250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.474489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.508153] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1041.511360] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a in Status: IN_PROGRESS for 2s [ 1041.522883] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.523876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.523876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.523876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.523876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.549444] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: IN_PROGRESS for 2s [ 1041.566946] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.567225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.567304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.569222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.570058] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.613532] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 993ce117-521f-4677-9ad6-2a219a7366c9 in Status: IN_PROGRESS for 2s [ 1041.622791] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1041.623485] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.623695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.623808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.624104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.624263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.680290] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 in Status: IN_PROGRESS for 2s [ 1041.825245] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.825469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.825469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.825783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.825958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.826088] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28a013f0-b993-4dc2-8d6d-063c011d939f already deleted. [ 1041.826185] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.826354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.826709] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.826833] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.351837] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.351837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.351837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.351837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.351837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.351837] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28a013f0-b993-4dc2-8d6d-063c011d939f already deleted. [ 1042.351837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.380335] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1042.380335] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 deletion is rescheduled due to dependency. [ 1042.380335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.380335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.380335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.380335] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.380335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.380335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.380335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.380868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.380868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.380868] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.441724] env[67003]: INFO networking_nsxv3.common.synchronization [req-2cc37806-2fb7-4b14-ab88-62ba9987019d req-398f30bf-3324-404c-88f6-57be3546d43e tempest-ServerDiskConfigTestJSON-448903628 tempest-ServerDiskConfigTestJSON-448903628-project-member] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 1042.442343] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 1042.443857] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.444044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.444169] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.444480] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.444662] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.444779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.444846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.445018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.445119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.445218] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.808927] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-548 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.810196] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.810196] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.810196] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.810196] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.810196] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.810196] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.810540] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.810829] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.811401] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.811583] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1042.811926] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1042.812269] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1042.812437] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1042.812543] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1042.812685] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1042.836619] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1042.836826] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1042.837049] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1042.837300] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-548" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.837651] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-50872aad-172d-440b-aa0a-ac2938962490 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.837841] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-50872aad-172d-440b-aa0a-ac2938962490" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.837960] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-50872aad-172d-440b-aa0a-ac2938962490" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.838770] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-50872aad-172d-440b-aa0a-ac2938962490" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.838864] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50872aad-172d-440b-aa0a-ac2938962490',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.883835] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.884024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.884085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.884446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.884617] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.884738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.884806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.884949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.885071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.885180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.885352] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.885451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.885505] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.885647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.885786] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.885875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.885934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.886082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.886157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.886248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.886344] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.948716] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.949020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.949020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.949119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.949209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.949496] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.949655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.949655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.949823] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.949904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.949975] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 1042.980054] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.980217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.980263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.980449] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.980590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.990269] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 1043.033574] env[67003]: INFO networking_nsxv3.common.synchronization [None req-42d3cc92-140d-4b5b-9dda-499b3859734f None None] Enqueued Resource ID: d38d7a21-0a2c-4c5f-b8ce-d0359b7ba21a with Priority: HIGHEST for action port [ 1043.035028] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d38d7a21-0a2c-4c5f-b8ce-d0359b7ba21a with Priority: HIGHEST for action port [ 1043.035028] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d38d7a21-0a2c-4c5f-b8ce-d0359b7ba21a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.035028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d38d7a21-0a2c-4c5f-b8ce-d0359b7ba21a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.035028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d38d7a21-0a2c-4c5f-b8ce-d0359b7ba21a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.035294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d38d7a21-0a2c-4c5f-b8ce-d0359b7ba21a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.035294] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d38d7a21-0a2c-4c5f-b8ce-d0359b7ba21a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.341485] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.342701] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.342830] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.343148] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.343298] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.343452] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 50872aad-172d-440b-aa0a-ac2938962490 not found, creating... [ 1043.343813] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.343964] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.344094] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.344343] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.344515] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.344852] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.345392] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.347024] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.347024] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.347024] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.347024] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 50872aad-172d-440b-aa0a-ac2938962490 is going to be created. [ 1043.388695] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.389025] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.389163] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.389457] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.389694] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.389922] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-50872aad-172d-440b-aa0a-ac2938962490" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.390776] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06d182ef-21b7-44fd-8cbf-2f35f7927435: rpc.has_security_group_logging(os_id): False [ 1043.427304] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.427528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.427598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.427842] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.428016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.428288] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.428417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.428492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.428667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.428771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.428967] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.429081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.429146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.429298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.429440] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.429639] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.429744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.429886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.430055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.430122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.430202] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1043.529156] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1043.529156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.529156] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a in Status: SUCCESS [ 1043.529156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.537961] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d38d7a21-0a2c-4c5f-b8ce-d0359b7ba21a [ 1043.537961] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.537961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.538121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.538292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.538405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.538525] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d38d7a21-0a2c-4c5f-b8ce-d0359b7ba21a already deleted. [ 1043.538639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d38d7a21-0a2c-4c5f-b8ce-d0359b7ba21a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.546263] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.546462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.546568] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.546810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.546987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.584022] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: SUCCESS [ 1043.584022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.585730] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1043.630794] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 993ce117-521f-4677-9ad6-2a219a7366c9 in Status: SUCCESS [ 1043.631349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.694384] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 in Status: SUCCESS [ 1043.694633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.090861] env[67003]: INFO networking_nsxv3.common.synchronization [req-2cc37806-2fb7-4b14-ab88-62ba9987019d req-ab8b8fc3-768b-452b-9709-891b6fb50384 service nova] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_rules [ 1044.091142] env[67003]: INFO networking_nsxv3.common.synchronization [req-2cc37806-2fb7-4b14-ab88-62ba9987019d req-ab8b8fc3-768b-452b-9709-891b6fb50384 service nova] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 1044.091223] env[67003]: INFO networking_nsxv3.common.synchronization [req-2cc37806-2fb7-4b14-ab88-62ba9987019d req-ab8b8fc3-768b-452b-9709-891b6fb50384 service nova] Enqueued Resource ID: 50872aad-172d-440b-aa0a-ac2938962490 with Priority: HIGHEST for action port [ 1044.091692] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_rules [ 1044.091823] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 1044.091920] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50872aad-172d-440b-aa0a-ac2938962490 with Priority: HIGHEST for action port [ 1044.092215] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.092346] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.092410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.092590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.092673] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.093468] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.094243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.094243] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-50872aad-172d-440b-aa0a-ac2938962490 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.094243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50872aad-172d-440b-aa0a-ac2938962490" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.094243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50872aad-172d-440b-aa0a-ac2938962490" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.094243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50872aad-172d-440b-aa0a-ac2938962490" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.094243] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50872aad-172d-440b-aa0a-ac2938962490',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.596732] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.598034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.598034] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 50872aad-172d-440b-aa0a-ac2938962490 with status ACTIVE [ 1044.598034] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.598034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.598034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.598034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.598034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.598369] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.598477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.598744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.598943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.599086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.599336] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.599517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.600363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.600363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.600363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.600363] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 50872aad-172d-440b-aa0a-ac2938962490 is going to be updated. [ 1044.624243] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.624379] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.624505] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.624675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.624816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.624977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50872aad-172d-440b-aa0a-ac2938962490" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.004505] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 1045.004711] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 deletion is rescheduled due to dependency. [ 1045.004779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.004956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.005199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.005388] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.005509] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.005570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.005721] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.005799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.005895] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.053159] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.053396] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.053524] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.053787] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.054136] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.054361] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.054504] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.054727] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.054872] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.055094] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.055205] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1045.055316] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1045.055453] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1045.055568] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1045.055672] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1045.055799] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1045.076539] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1045.076788] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1045.076932] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1045.077127] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.077447] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-0acc8972-7afe-418e-96b9-4c8ddddd8d53 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.077625] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.077744] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.077996] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.078144] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0acc8972-7afe-418e-96b9-4c8ddddd8d53',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.509097] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.580758] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.581103] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.581186] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.581453] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.581674] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.581894] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.582061] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.582186] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.582398] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.582538] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.582820] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.582988] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.583125] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.583331] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.583464] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.583604] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 0acc8972-7afe-418e-96b9-4c8ddddd8d53 is going to be updated. [ 1045.602743] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1045.602985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.606777] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.606987] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.607123] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.607386] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.607579] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.607789] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.011050] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.347073] env[67003]: INFO networking_nsxv3.common.synchronization [req-193518e2-ef91-47d7-bb76-f729ea02696b req-ef0d2298-c2c0-4dda-8476-97089df399bd service nova] Enqueued Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_rules [ 1046.347292] env[67003]: INFO networking_nsxv3.common.synchronization [req-193518e2-ef91-47d7-bb76-f729ea02696b req-ef0d2298-c2c0-4dda-8476-97089df399bd service nova] Enqueued Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_members [ 1046.347451] env[67003]: INFO networking_nsxv3.common.synchronization [req-193518e2-ef91-47d7-bb76-f729ea02696b req-ef0d2298-c2c0-4dda-8476-97089df399bd service nova] Enqueued Resource ID: 0acc8972-7afe-418e-96b9-4c8ddddd8d53 with Priority: HIGHEST for action port [ 1046.347996] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_rules [ 1046.348338] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_members [ 1046.348447] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0acc8972-7afe-418e-96b9-4c8ddddd8d53 with Priority: HIGHEST for action port [ 1046.351262] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.351454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.351554] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.351799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.351970] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.352974] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-745fb2b7-cb25-4398-b51d-8a61982bb1ed taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.354033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.354033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.354033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.354033] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.354033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.354033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.354033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.354033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.354033] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.355062] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0acc8972-7afe-418e-96b9-4c8ddddd8d53 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.355998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.355998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.355998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.355998] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0acc8972-7afe-418e-96b9-4c8ddddd8d53',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.515758] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.515758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.515758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.515758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.515758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.515758] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 1046.546724] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.546865] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.546939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.547231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.548017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.556732] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 1046.857700] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.858922] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-745fb2b7-cb25-4398-b51d-8a61982bb1ed taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.859139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.859729] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0acc8972-7afe-418e-96b9-4c8ddddd8d53 with status ACTIVE [ 1046.859729] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.859729] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.860273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.860273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.860273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.860412] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.860492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.860703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.860801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.860801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.861019] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.861143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.861182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.862146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.862146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.862146] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0acc8972-7afe-418e-96b9-4c8ddddd8d53 is going to be updated. [ 1046.905486] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.905658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.905722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.907499] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.907499] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.907499] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0acc8972-7afe-418e-96b9-4c8ddddd8d53" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.364305] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1047.867730] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.868116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.868116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.868431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.868557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.868722] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed is going to be updated. [ 1047.906701] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.907374] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.907742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.908044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.908432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.919817] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed in Status: IN_PROGRESS for 2s [ 1048.045379] env[67003]: INFO networking_nsxv3.common.synchronization [req-244e0f81-1152-45ee-8957-fc1caed56172 req-6339abc5-0021-4220-8125-9f7bde4f3b7e tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1048.045539] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1048.046104] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.046104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.046104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.046565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.049171] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.049171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.049171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.049171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.049171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.049171] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.397046] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.397328] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.397502] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.397809] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.398126] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.398342] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.398489] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.398761] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.398957] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.399214] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.399361] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.399480] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.399591] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.399700] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.399804] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.399931] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.423847] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.426023] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1048.426023] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.426023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.426023] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-98d3a995-c8d2-49cb-9cfc-76c36784838b taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.426023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-98d3a995-c8d2-49cb-9cfc-76c36784838b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.426023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-98d3a995-c8d2-49cb-9cfc-76c36784838b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.426500] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-98d3a995-c8d2-49cb-9cfc-76c36784838b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.426799] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d3a995-c8d2-49cb-9cfc-76c36784838b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.549370] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.567946] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 1048.568172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.568572] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.568790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.568976] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.569110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.569176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.569328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.569405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.569487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.569576] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.929849] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.930312] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.930312] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.930500] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.930644] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.930805] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 98d3a995-c8d2-49cb-9cfc-76c36784838b not found, creating... [ 1048.931122] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.931316] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.931522] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.931711] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.931852] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.932174] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.932340] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.932666] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.932933] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.933128] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.933301] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 98d3a995-c8d2-49cb-9cfc-76c36784838b is going to be created. [ 1048.954544] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.954860] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.955166] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.955582] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.955912] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.956282] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-98d3a995-c8d2-49cb-9cfc-76c36784838b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.051293] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.072029] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.072029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.072029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.072029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.072375] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.072441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.072549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.072788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.072914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.073058] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.073280] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.073421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.073513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.073723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.073930] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.074081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.074178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.074380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.074514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.074631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.074767] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.554091] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.554249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.554328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.554673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.554673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.554787] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1049.577612] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25f0058d-8729-4623-a291-7d3376597063: rpc.has_security_group_logging(os_id): False [ 1049.585655] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.585879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.585923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.586148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.586297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.596738] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1049.597737] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.597996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.598144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.598407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.598505] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.598746] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.598911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.599043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.599252] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.599370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.599600] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.599752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.599829] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.599983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.600163] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.600312] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.600417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.600477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.600621] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.600696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.600783] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 1049.646360] env[67003]: INFO networking_nsxv3.common.synchronization [req-244e0f81-1152-45ee-8957-fc1caed56172 req-bc9961b7-b5fd-4121-ac66-49c48eed88ed service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1049.646566] env[67003]: INFO networking_nsxv3.common.synchronization [req-244e0f81-1152-45ee-8957-fc1caed56172 req-bc9961b7-b5fd-4121-ac66-49c48eed88ed service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1049.646715] env[67003]: INFO networking_nsxv3.common.synchronization [req-244e0f81-1152-45ee-8957-fc1caed56172 req-bc9961b7-b5fd-4121-ac66-49c48eed88ed service nova] Enqueued Resource ID: 98d3a995-c8d2-49cb-9cfc-76c36784838b with Priority: HIGHEST for action port [ 1049.647642] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1049.647781] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1049.647900] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98d3a995-c8d2-49cb-9cfc-76c36784838b with Priority: HIGHEST for action port [ 1049.648165] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.648291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.648351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.648687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.648687] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.649478] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.649580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.649772] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-98d3a995-c8d2-49cb-9cfc-76c36784838b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.649872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98d3a995-c8d2-49cb-9cfc-76c36784838b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.649935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98d3a995-c8d2-49cb-9cfc-76c36784838b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.650130] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98d3a995-c8d2-49cb-9cfc-76c36784838b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.650208] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98d3a995-c8d2-49cb-9cfc-76c36784838b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.675205] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.675414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.675414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.675657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.675808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.691789] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 1049.932129] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed in Status: SUCCESS [ 1049.932129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.932581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.932581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.932677] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.932817] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.932862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.933049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.933127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.933218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.933309] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.152221] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.152320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.152599] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98d3a995-c8d2-49cb-9cfc-76c36784838b with status ACTIVE [ 1050.152798] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.152968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.153076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.153272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.153354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.153652] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.153744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.154132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.154132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.154132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.154357] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.154435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.154505] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.154653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.154735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.154822] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98d3a995-c8d2-49cb-9cfc-76c36784838b is going to be updated. [ 1050.179532] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.179734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.179838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.180137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.180311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.180490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98d3a995-c8d2-49cb-9cfc-76c36784838b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.436082] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.938165] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 745fb2b7-cb25-4398-b51d-8a61982bb1ed: rpc.has_security_group_logging(os_id): False [ 1050.959658] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.959892] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.959946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.960223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.960382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.960612] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.960847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.960847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.960999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.961075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.961168] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed is going to be created. [ 1051.046858] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.046858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.046858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.047118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.047118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.094526] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed in Status: IN_PROGRESS for 2s [ 1051.607189] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1051.607507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.607754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.608038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.608293] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.608421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.608921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.608921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.608921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.608921] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1051.714428] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 1051.714647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.111205] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1052.615856] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.109161] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed in Status: SUCCESS [ 1053.109637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.119462] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.119860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.119860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.119947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.120013] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.120121] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1053.165493] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.165709] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.165761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.166082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.166278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.176319] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1053.399109] env[67003]: INFO networking_nsxv3.common.synchronization [req-7f466c01-6134-496d-8bee-ba943685a4b8 req-c46ab0c7-21f2-466e-a3ae-7982eb24abb4 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_members [ 1053.399870] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_members [ 1053.401315] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.401315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.401315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.401315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.401720] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.401720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.401720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.401876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.402041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.402134] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.851167] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.851524] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.851776] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.852253] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.852656] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.852893] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.853092] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.853433] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.853671] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.854016] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.854516] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1053.854516] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1053.854516] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1053.854670] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1053.854850] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1053.854911] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1053.882683] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1053.882946] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1053.883081] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1053.883211] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.883585] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-2c732611-e47d-47e2-8098-829c8464d7a4 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.883792] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-2c732611-e47d-47e2-8098-829c8464d7a4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.883917] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-2c732611-e47d-47e2-8098-829c8464d7a4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.884382] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-2c732611-e47d-47e2-8098-829c8464d7a4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.884619] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c732611-e47d-47e2-8098-829c8464d7a4',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.907022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.907491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.907491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.907643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.907722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.907904] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.908079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.908156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.908380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.908465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.908579] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 already deleted. [ 1053.908661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.387720] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.387720] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.387720] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.388218] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.388218] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.388324] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 2c732611-e47d-47e2-8098-829c8464d7a4 not found, creating... [ 1054.388633] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.388815] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.388957] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.390058] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.390058] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.390058] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.390058] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.390058] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.390358] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.390358] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.390358] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 2c732611-e47d-47e2-8098-829c8464d7a4 is going to be created. [ 1054.411554] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.411780] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.411907] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.412201] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.412416] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.412635] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-2c732611-e47d-47e2-8098-829c8464d7a4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.761032] env[67003]: INFO networking_nsxv3.common.synchronization [req-43a7da53-0001-4c50-a35a-c3aa94a9ddd7 req-d5edae53-aa50-46d7-a91b-b30b649e2198 tempest-ServerDiskConfigTestJSON-448903628 tempest-ServerDiskConfigTestJSON-448903628-project-member] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 1054.761654] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGHEST for action security_group_members [ 1054.762076] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.762371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.762453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.762682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.762874] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.762987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.763087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.763233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.763736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.763857] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.171183] env[67003]: INFO networking_nsxv3.common.synchronization [req-7f466c01-6134-496d-8bee-ba943685a4b8 req-c0e32f7f-ae12-4491-95eb-a7a199f3bdbb service nova] Enqueued Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_rules [ 1055.171468] env[67003]: INFO networking_nsxv3.common.synchronization [req-7f466c01-6134-496d-8bee-ba943685a4b8 req-c0e32f7f-ae12-4491-95eb-a7a199f3bdbb service nova] Enqueued Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_members [ 1055.171570] env[67003]: INFO networking_nsxv3.common.synchronization [req-7f466c01-6134-496d-8bee-ba943685a4b8 req-c0e32f7f-ae12-4491-95eb-a7a199f3bdbb service nova] Enqueued Resource ID: 2c732611-e47d-47e2-8098-829c8464d7a4 with Priority: HIGHEST for action port [ 1055.172318] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_rules [ 1055.172318] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_members [ 1055.172461] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c732611-e47d-47e2-8098-829c8464d7a4 with Priority: HIGHEST for action port [ 1055.172683] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.172810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.172875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.173092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.173177] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.174256] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.174256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.174256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.174498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.174589] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.174660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.174726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.175110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.175110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.175110] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.177059] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c732611-e47d-47e2-8098-829c8464d7a4 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.177489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c732611-e47d-47e2-8098-829c8464d7a4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.177489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c732611-e47d-47e2-8098-829c8464d7a4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.177489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c732611-e47d-47e2-8098-829c8464d7a4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.177703] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c732611-e47d-47e2-8098-829c8464d7a4',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.193021] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1055.193021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.193021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.193021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.193021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.193021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.193021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.193021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.193021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.193021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.193571] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.267359] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.267517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.267596] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.268052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.268052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.268161] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.268161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.268248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.268888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.268888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.268888] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be updated. [ 1055.302962] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.303125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.303125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.303301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.303446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.314195] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: IN_PROGRESS for 2s [ 1055.680069] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.681279] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.681362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.684131] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c732611-e47d-47e2-8098-829c8464d7a4 with status ACTIVE [ 1055.684325] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.684442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.684518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.684707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.684794] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.684999] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.685112] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.685170] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.685309] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.685398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.685554] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.685676] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.685739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.685816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.685888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.685986] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c732611-e47d-47e2-8098-829c8464d7a4 is going to be updated. [ 1055.694864] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.695064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.695116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.695286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.695447] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.695547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.695610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.695753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.695834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.695917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.696076] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.696166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.696226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.696362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.696533] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.696603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.696666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.696801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.696873] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.696952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.697046] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.708867] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.709105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.709105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.709267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.709403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.709559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c732611-e47d-47e2-8098-829c8464d7a4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.184946] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.199039] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f76f58af-f507-4428-b198-11ce6caf814d: rpc.has_security_group_logging(os_id): False [ 1056.227220] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.227463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.227463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.227708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.227849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.228163] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.228300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.228398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.228643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.228718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.228934] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.229093] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.229198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.229437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.229566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.229826] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.229973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.230073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.230333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.230450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.230546] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1056.295587] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.295587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.295702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.296041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.296260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.314802] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1056.687962] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.688329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.688329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.688575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.688720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.688923] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 is going to be created. [ 1056.717215] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.717382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.717448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.717714] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.717890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.727131] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: UNINITIALIZED for 2s [ 1056.849657] env[67003]: INFO networking_nsxv3.common.synchronization [req-297335a6-1c16-41dd-adf7-2c165479ae0b req-049e0fa2-dc07-474e-99ca-0787caa21296 tempest-AttachInterfacesUnderV243Test-564471411 tempest-AttachInterfacesUnderV243Test-564471411-project-member] Enqueued Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1056.850277] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1056.850984] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.850984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.850984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.851270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.851421] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.851580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.851618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.851755] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.851885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.852050] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.291248] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-822 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.291373] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-822" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.291501] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-822" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.291891] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-822" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.292271] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.292476] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.292651] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.292894] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.293125] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.293413] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.293558] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1057.293698] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1057.293836] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1057.293977] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1057.294125] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1057.294290] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1057.319046] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1057.319046] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1057.319314] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1057.319384] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-822" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.319772] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-458629a3-fe57-4d5b-9786-c958c3c43d38 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.320480] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.320480] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.320805] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.320805] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('458629a3-fe57-4d5b-9786-c958c3c43d38',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.325241] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25f0058d-8729-4623-a291-7d3376597063 in Status: SUCCESS [ 1057.325544] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25f0058d-8729-4623-a291-7d3376597063 deletion is rescheduled due to dependency. [ 1057.325701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.355039] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.355387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.356283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.356283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.356283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.356283] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.356283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.356283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.356650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.356650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.356650] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a013f0-b993-4dc2-8d6d-063c011d939f already deleted. [ 1057.356752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.823586] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.823908] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.823908] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.824266] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.824452] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.824688] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 458629a3-fe57-4d5b-9786-c958c3c43d38 not found, creating... [ 1057.825019] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.825197] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.825471] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.825682] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.825867] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.826192] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.826356] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.826480] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.826731] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.826866] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.827019] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 458629a3-fe57-4d5b-9786-c958c3c43d38 is going to be created. [ 1057.851797] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.852058] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.852176] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.852462] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.852715] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.852928] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.332419] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1058.332606] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.575634] env[67003]: INFO networking_nsxv3.common.synchronization [req-297335a6-1c16-41dd-adf7-2c165479ae0b req-34889703-4fe5-4d2e-99da-ba8f64caa8c1 service nova] Enqueued Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_rules [ 1058.575776] env[67003]: INFO networking_nsxv3.common.synchronization [req-297335a6-1c16-41dd-adf7-2c165479ae0b req-34889703-4fe5-4d2e-99da-ba8f64caa8c1 service nova] Enqueued Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1058.576040] env[67003]: INFO networking_nsxv3.common.synchronization [req-297335a6-1c16-41dd-adf7-2c165479ae0b req-34889703-4fe5-4d2e-99da-ba8f64caa8c1 service nova] Enqueued Resource ID: 458629a3-fe57-4d5b-9786-c958c3c43d38 with Priority: HIGHEST for action port [ 1058.576977] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_rules [ 1058.577091] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1058.577279] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458629a3-fe57-4d5b-9786-c958c3c43d38 with Priority: HIGHEST for action port [ 1058.577726] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.577927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.578201] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.578762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.578762] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.580945] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.580945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.580945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.580945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.580945] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.580945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.580945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.581269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.581308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.582274] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.583325] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-458629a3-fe57-4d5b-9786-c958c3c43d38 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.583468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.583588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.583846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.586400] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('458629a3-fe57-4d5b-9786-c958c3c43d38',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.738842] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: SUCCESS [ 1058.739140] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.739332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.739561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.739764] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.739891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.739961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.740124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.740204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.740288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.740383] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.085916] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.085916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.088946] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.088946] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 458629a3-fe57-4d5b-9786-c958c3c43d38 with status ACTIVE [ 1059.088946] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.088946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.088946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.089282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.089383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.089963] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.089963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.089963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.089963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.089963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.090431] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.090562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.090604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.090778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.090869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.090990] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 458629a3-fe57-4d5b-9786-c958c3c43d38 is going to be updated. [ 1059.114407] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.114624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.114710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.115047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.115204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.115378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.242541] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.329153] env[67003]: INFO networking_nsxv3.common.synchronization [req-2bf8af28-7e6a-4b51-820f-2bb1e8232dd1 req-d2b0a4e9-2725-4ab2-b630-8c615168ae32 tempest-DeleteServersTestJSON-1342989894 tempest-DeleteServersTestJSON-1342989894-project-member] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1059.329809] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1059.330286] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.330486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.330590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.330825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.331024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.331157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.331234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.331443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.331622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.331798] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.593562] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.686260] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-521 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.686260] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.686260] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.686260] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.686652] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.687830] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.687830] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.687830] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.687830] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.687830] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.687830] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1059.688178] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1059.688261] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1059.688527] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1059.688704] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1059.688891] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1059.709507] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1059.709830] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1059.710796] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1059.710796] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.710796] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-9b217ee7-cb01-4b33-a4a8-da1a76bea501 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.710796] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-9b217ee7-cb01-4b33-a4a8-da1a76bea501" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.711102] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-9b217ee7-cb01-4b33-a4a8-da1a76bea501" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.711383] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-9b217ee7-cb01-4b33-a4a8-da1a76bea501" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.711571] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b217ee7-cb01-4b33-a4a8-da1a76bea501',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.744781] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7a3c46b-3fe8-4a52-b683-e71e757f6303: rpc.has_security_group_logging(os_id): False [ 1059.768083] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.768298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.768377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.768652] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.768805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.769181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.769340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.769408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.769653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.769916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.769916] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 is going to be created. [ 1059.833853] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.834051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.834097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.834353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.834644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.836353] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.836498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.836654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.836913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.837017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.837254] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.837333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.837333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.837478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.837629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.837751] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1059.855511] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: IN_PROGRESS for 2s [ 1059.877432] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.877432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.878145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.878145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.878145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.890482] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1060.097107] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.097506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.097506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.097711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.097769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.098741] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a013f0-b993-4dc2-8d6d-063c011d939f is going to be created. [ 1060.129947] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.130096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.130167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.130379] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.130551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.141522] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a013f0-b993-4dc2-8d6d-063c011d939f in Status: UNINITIALIZED for 2s [ 1060.215204] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.215549] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.215734] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.215978] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.216188] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.216285] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 9b217ee7-cb01-4b33-a4a8-da1a76bea501 not found, creating... [ 1060.216641] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.216805] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.216922] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.217181] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.217413] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.217600] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.217752] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.217867] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.218215] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.218350] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.218520] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 9b217ee7-cb01-4b33-a4a8-da1a76bea501 is going to be created. [ 1060.240078] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.240314] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.240458] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.240724] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.240949] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.241199] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-9b217ee7-cb01-4b33-a4a8-da1a76bea501" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.006687] env[67003]: INFO networking_nsxv3.common.synchronization [req-2bf8af28-7e6a-4b51-820f-2bb1e8232dd1 req-3381c954-ca5a-47f1-9ed3-23fc8b4649f4 service nova] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_rules [ 1061.006922] env[67003]: INFO networking_nsxv3.common.synchronization [req-2bf8af28-7e6a-4b51-820f-2bb1e8232dd1 req-3381c954-ca5a-47f1-9ed3-23fc8b4649f4 service nova] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1061.007099] env[67003]: INFO networking_nsxv3.common.synchronization [req-2bf8af28-7e6a-4b51-820f-2bb1e8232dd1 req-3381c954-ca5a-47f1-9ed3-23fc8b4649f4 service nova] Enqueued Resource ID: 9b217ee7-cb01-4b33-a4a8-da1a76bea501 with Priority: HIGHEST for action port [ 1061.007776] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_rules [ 1061.007923] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1061.008494] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b217ee7-cb01-4b33-a4a8-da1a76bea501 with Priority: HIGHEST for action port [ 1061.008494] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.008494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.008718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.008771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.008872] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.009791] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.009892] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.010118] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b217ee7-cb01-4b33-a4a8-da1a76bea501 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.010221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b217ee7-cb01-4b33-a4a8-da1a76bea501" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.010294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b217ee7-cb01-4b33-a4a8-da1a76bea501" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.010457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b217ee7-cb01-4b33-a4a8-da1a76bea501" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.010524] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b217ee7-cb01-4b33-a4a8-da1a76bea501',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.512406] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.512766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.512766] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b217ee7-cb01-4b33-a4a8-da1a76bea501 with status ACTIVE [ 1061.512913] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.513034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.513101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.513307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.513395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.513557] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.513651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.513712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.513870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.513944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.514130] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.514222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.514283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.514416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.514496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.514622] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b217ee7-cb01-4b33-a4a8-da1a76bea501 is going to be updated. [ 1061.536660] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.536907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.536907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.537106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.537253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.537415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b217ee7-cb01-4b33-a4a8-da1a76bea501" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.874080] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: SUCCESS [ 1061.875520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.903746] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1061.904013] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 deletion is rescheduled due to dependency. [ 1061.904209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.904520] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.904763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.905107] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.905314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.905459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.906124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.906124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.906124] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.156951] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a013f0-b993-4dc2-8d6d-063c011d939f in Status: SUCCESS [ 1062.157809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.157953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.158328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.158804] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.159049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.159049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.159238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.159317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.159413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.159590] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.408492] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.662691] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.911322] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.165338] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28a013f0-b993-4dc2-8d6d-063c011d939f: rpc.has_security_group_logging(os_id): False [ 1063.189187] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.189419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.189531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.189761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.189856] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.190151] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.190292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.190343] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.190510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.190627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.190675] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28a013f0-b993-4dc2-8d6d-063c011d939f is going to be created. [ 1063.261557] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.261557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.261557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.261557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.261557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.274641] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28a013f0-b993-4dc2-8d6d-063c011d939f in Status: IN_PROGRESS for 2s [ 1063.413753] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.413968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.414265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.414265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.414369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.414517] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1063.468604] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.468924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.468924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.469090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.469296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.479819] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1063.686577] env[67003]: INFO networking_nsxv3.common.synchronization [req-f2129792-bdee-462d-9dfe-874cb49de4aa req-2adc8ecf-3761-4718-a0c3-b854ed745a77 tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1063.687063] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1063.687519] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.687671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.687774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.688194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.688456] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.688636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.689123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.689123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.689123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.689431] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.194845] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.697918] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.202228] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.202228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.202228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.202228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.202228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.202228] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1065.240484] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.240696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.240780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.240947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.241136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.254885] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1065.288517] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28a013f0-b993-4dc2-8d6d-063c011d939f in Status: SUCCESS [ 1065.288760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.497470] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1065.497470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.497470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.497470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.497470] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.497470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.497470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.497470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.497470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.497470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.497470] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.000766] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.001287] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.001380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.002504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.002504] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.002504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.002504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.002504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.002504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.002504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.002504] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.002947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.002947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.002947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.002947] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.003095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.003095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.003235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.003318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.003402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.003493] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.506810] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06d182ef-21b7-44fd-8cbf-2f35f7927435: rpc.has_security_group_logging(os_id): False [ 1066.529929] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.531292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.531418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.531656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.531760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.532370] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.532370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.532370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.532629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.532629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.533472] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.533619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.533690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.533862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.533952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.534406] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.534406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.534617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.534617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.534727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.534778] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1066.600076] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.600650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.600858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.601183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.601429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.629981] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1066.988347] env[67003]: INFO networking_nsxv3.common.synchronization [None req-102ec93f-3217-4075-85d0-ea79e22dca1b None None] Enqueued Resource ID: fc374acb-9866-4685-8fc3-2d864ae5e162 with Priority: HIGHEST for action port [ 1066.988577] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fc374acb-9866-4685-8fc3-2d864ae5e162 with Priority: HIGHEST for action port [ 1066.989444] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-fc374acb-9866-4685-8fc3-2d864ae5e162 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.989444] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fc374acb-9866-4685-8fc3-2d864ae5e162" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.989444] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fc374acb-9866-4685-8fc3-2d864ae5e162" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.989444] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fc374acb-9866-4685-8fc3-2d864ae5e162" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.989444] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fc374acb-9866-4685-8fc3-2d864ae5e162',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.268235] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1067.268574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.495046] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fc374acb-9866-4685-8fc3-2d864ae5e162 [ 1067.495046] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.495046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.495046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.496918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.497032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.497174] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fc374acb-9866-4685-8fc3-2d864ae5e162 already deleted. [ 1067.497349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fc374acb-9866-4685-8fc3-2d864ae5e162" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.650149] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1068.651023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.800787] env[67003]: INFO networking_nsxv3.common.synchronization [None req-61385766-2e01-4e08-ac95-86a011ca24b3 None None] Enqueued Resource ID: 12d3eef1-d4df-4b85-92b8-caa29703229a with Priority: HIGHEST for action port [ 1069.801261] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12d3eef1-d4df-4b85-92b8-caa29703229a with Priority: HIGHEST for action port [ 1069.801628] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-12d3eef1-d4df-4b85-92b8-caa29703229a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.801798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12d3eef1-d4df-4b85-92b8-caa29703229a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.801872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12d3eef1-d4df-4b85-92b8-caa29703229a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.802125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12d3eef1-d4df-4b85-92b8-caa29703229a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.802220] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12d3eef1-d4df-4b85-92b8-caa29703229a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.304392] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 12d3eef1-d4df-4b85-92b8-caa29703229a [ 1070.304715] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.304849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.304987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.305266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.305369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.305468] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:12d3eef1-d4df-4b85-92b8-caa29703229a already deleted. [ 1070.305553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12d3eef1-d4df-4b85-92b8-caa29703229a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.559664] env[67003]: INFO networking_nsxv3.common.synchronization [req-a91ba688-8980-4b5e-bf63-74c7bd3780b7 req-abdf313d-521c-4bdc-9cba-f99c97125df7 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_members [ 1071.560922] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_members [ 1071.560922] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.560922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.560922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.560922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.560922] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.561701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.561701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.561701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.561701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.561701] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.606152] env[67003]: INFO networking_nsxv3.common.synchronization [req-7981bc4c-a088-4126-a27d-b7352dd9a687 req-55453465-752e-42cf-8147-3b3ee742b2ca tempest-ServerActionsV293TestJSON-1797352496 tempest-ServerActionsV293TestJSON-1797352496-project-member] Enqueued Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGHEST for action security_group_members [ 1071.606777] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGHEST for action security_group_members [ 1071.607812] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.607916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.607982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.608271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.608342] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.608430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.608490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.608638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.608726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.608823] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.042762] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.042980] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.043154] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.043437] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.043638] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.043798] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.043941] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.044228] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.044391] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.044648] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.044786] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1072.044899] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1072.045031] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1072.047062] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1072.047062] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1072.047062] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1072.063438] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.075085] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1072.075333] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1072.075503] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1072.076911] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.076911] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-120ea044-8504-41d4-9a5c-15b7e028079e taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.076911] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-120ea044-8504-41d4-9a5c-15b7e028079e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.076911] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-120ea044-8504-41d4-9a5c-15b7e028079e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.076911] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-120ea044-8504-41d4-9a5c-15b7e028079e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.077283] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('120ea044-8504-41d4-9a5c-15b7e028079e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.111298] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.111548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.111663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.111891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.111988] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.112208] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.112336] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.112401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.112556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.112630] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.112719] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a is going to be updated. [ 1072.145266] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.145266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.145266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.145266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.145266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.157413] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a in Status: IN_PROGRESS for 2s [ 1072.565340] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.579950] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.580274] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.580428] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.580884] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.581164] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.581431] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 120ea044-8504-41d4-9a5c-15b7e028079e not found, creating... [ 1072.581757] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.581977] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.582167] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.582356] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.582500] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.582820] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.583020] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.583174] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.583457] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.583666] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.583835] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 120ea044-8504-41d4-9a5c-15b7e028079e is going to be created. [ 1072.605875] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.606123] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.606221] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.606492] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.606784] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.607014] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-120ea044-8504-41d4-9a5c-15b7e028079e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.070761] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.070761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.070761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.070761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.070761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.070761] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 is going to be updated. [ 1073.101549] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.101767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.101851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.102600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.102600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.114040] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: IN_PROGRESS for 2s [ 1073.321784] env[67003]: INFO networking_nsxv3.common.synchronization [req-a91ba688-8980-4b5e-bf63-74c7bd3780b7 req-7d156379-1c51-45f5-a9b1-8a1c53b1d8d2 service nova] Enqueued Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_rules [ 1073.321955] env[67003]: INFO networking_nsxv3.common.synchronization [req-a91ba688-8980-4b5e-bf63-74c7bd3780b7 req-7d156379-1c51-45f5-a9b1-8a1c53b1d8d2 service nova] Enqueued Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_members [ 1073.322145] env[67003]: INFO networking_nsxv3.common.synchronization [req-a91ba688-8980-4b5e-bf63-74c7bd3780b7 req-7d156379-1c51-45f5-a9b1-8a1c53b1d8d2 service nova] Enqueued Resource ID: 120ea044-8504-41d4-9a5c-15b7e028079e with Priority: HIGHEST for action port [ 1073.323512] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_rules [ 1073.323512] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_members [ 1073.323512] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 120ea044-8504-41d4-9a5c-15b7e028079e with Priority: HIGHEST for action port [ 1073.324054] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.324054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.324054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.324194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.324331] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.325343] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.325477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.325793] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-120ea044-8504-41d4-9a5c-15b7e028079e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.325958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-120ea044-8504-41d4-9a5c-15b7e028079e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.326402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-120ea044-8504-41d4-9a5c-15b7e028079e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.326657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-120ea044-8504-41d4-9a5c-15b7e028079e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.326759] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('120ea044-8504-41d4-9a5c-15b7e028079e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.622537] env[67003]: INFO networking_nsxv3.common.synchronization [req-a3617e65-402d-407d-a17c-a3b63073b8dd req-0a6c67c6-6436-4fec-840f-3e90e017b6d2 tempest-ServerActionsTestJSON-1949922754 tempest-ServerActionsTestJSON-1949922754-project-member] Enqueued Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGHEST for action security_group_members [ 1073.623106] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGHEST for action security_group_members [ 1073.623913] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-993ce117-521f-4677-9ad6-2a219a7366c9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.623913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.623913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.624095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.624128] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.624222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.624279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.624423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.624542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.624616] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.830522] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.830652] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.830830] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 120ea044-8504-41d4-9a5c-15b7e028079e with status ACTIVE [ 1073.831126] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.831126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.831269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.832160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.832160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.832160] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.832160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.832160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.832160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.832160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.832531] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.832917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.832917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.833022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.833105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.833191] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 120ea044-8504-41d4-9a5c-15b7e028079e is going to be updated. [ 1073.859635] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.859844] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.859844] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.860180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.860400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.860695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-120ea044-8504-41d4-9a5c-15b7e028079e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.107686] env[67003]: INFO networking_nsxv3.common.synchronization [req-e22fa025-50c8-4164-a1d4-81078baf50db req-fc931376-974d-4174-8813-7e7928b093a8 tempest-InstanceActionsV221TestJSON-422956372 tempest-InstanceActionsV221TestJSON-422956372-project-member] Enqueued Resource ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 with Priority: HIGHEST for action security_group_members [ 1074.108509] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 with Priority: HIGHEST for action security_group_members [ 1074.108829] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0a0dd07-31c8-4f23-b815-1cf422605b14 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.108950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.109107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.109366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.109738] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.109738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.109738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.109906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.109906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.109996] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0a0dd07-31c8-4f23-b815-1cf422605b14',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.128352] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.128352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.128352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.128352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.128352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.128352] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.128352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.128646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.128646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.128646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.128749] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 993ce117-521f-4677-9ad6-2a219a7366c9 is going to be updated. [ 1074.170331] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a in Status: SUCCESS [ 1074.170560] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a deletion is rescheduled due to dependency. [ 1074.170679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.172679] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.172920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.173035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.173292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.173539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.183858] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993ce117-521f-4677-9ad6-2a219a7366c9 in Status: IN_PROGRESS for 2s [ 1074.470288] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-212 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.470491] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-212" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.470618] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-212" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.472855] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-212" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.473160] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.473331] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.473450] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.473690] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.473836] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.474060] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.474175] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.474285] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.474393] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.474506] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.474632] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.474764] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.495245] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.495435] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.495555] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.495735] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-212" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.496122] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-4c86bfa9-3823-477c-a644-2010c24241ff taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.496315] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-4c86bfa9-3823-477c-a644-2010c24241ff" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.496436] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-4c86bfa9-3823-477c-a644-2010c24241ff" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.496817] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-4c86bfa9-3823-477c-a644-2010c24241ff" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.496961] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c86bfa9-3823-477c-a644-2010c24241ff',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.612641] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.612641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.612903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.612903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.612985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.613245] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.613312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.613353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.613582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.613582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.613694] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 already deleted. [ 1074.613694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.999698] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.000078] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.000303] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.000637] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.000814] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.001071] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 4c86bfa9-3823-477c-a644-2010c24241ff not found, creating... [ 1075.001440] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.001654] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.001835] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.002157] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.002320] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.002655] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.002827] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.002944] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.003188] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.003324] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.003466] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 4c86bfa9-3823-477c-a644-2010c24241ff is going to be created. [ 1075.028243] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.028559] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.028559] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.028847] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.029106] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.029328] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-4c86bfa9-3823-477c-a644-2010c24241ff" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.124079] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: SUCCESS [ 1075.124400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.124585] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.124832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.125105] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.125280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.125364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.125551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.125640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.125741] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.628705] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.760548] env[67003]: INFO networking_nsxv3.common.synchronization [req-e22fa025-50c8-4164-a1d4-81078baf50db req-f9779eca-5a5d-4061-8534-2f1af31639c5 service nova] Enqueued Resource ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 with Priority: HIGHEST for action security_group_rules [ 1075.760721] env[67003]: INFO networking_nsxv3.common.synchronization [req-e22fa025-50c8-4164-a1d4-81078baf50db req-f9779eca-5a5d-4061-8534-2f1af31639c5 service nova] Enqueued Resource ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 with Priority: HIGHEST for action security_group_members [ 1075.760939] env[67003]: INFO networking_nsxv3.common.synchronization [req-e22fa025-50c8-4164-a1d4-81078baf50db req-f9779eca-5a5d-4061-8534-2f1af31639c5 service nova] Enqueued Resource ID: 4c86bfa9-3823-477c-a644-2010c24241ff with Priority: HIGHEST for action port [ 1075.761460] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 with Priority: HIGHEST for action security_group_rules [ 1075.761585] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 with Priority: HIGHEST for action security_group_members [ 1075.761685] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c86bfa9-3823-477c-a644-2010c24241ff with Priority: HIGHEST for action port [ 1075.761958] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b0a0dd07-31c8-4f23-b815-1cf422605b14 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.762196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.762269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.762516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.762592] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b0a0dd07-31c8-4f23-b815-1cf422605b14',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.763899] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0a0dd07-31c8-4f23-b815-1cf422605b14 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.764040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.764109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.764304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.764416] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.764508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.764564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.764706] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.764790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.764884] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0a0dd07-31c8-4f23-b815-1cf422605b14',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.765699] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c86bfa9-3823-477c-a644-2010c24241ff taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.765814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c86bfa9-3823-477c-a644-2010c24241ff" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.765862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c86bfa9-3823-477c-a644-2010c24241ff" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.766033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c86bfa9-3823-477c-a644-2010c24241ff" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.766111] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c86bfa9-3823-477c-a644-2010c24241ff',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.909422] env[67003]: INFO networking_nsxv3.common.synchronization [req-7f5331ce-50cb-4edf-aac2-3239aec3abe4 req-c259adc5-9a54-49f5-96c1-1766d117d268 tempest-DeleteServersTestJSON-1342989894 tempest-DeleteServersTestJSON-1342989894-project-member] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1075.909934] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1075.910275] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.910393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.910468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.910662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.910816] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.910914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.910985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.911136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.911232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.911313] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.131421] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.197725] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 993ce117-521f-4677-9ad6-2a219a7366c9 in Status: SUCCESS [ 1076.197725] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 993ce117-521f-4677-9ad6-2a219a7366c9 deletion is rescheduled due to dependency. [ 1076.197725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.268056] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b0a0dd07-31c8-4f23-b815-1cf422605b14',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.268862] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0a0dd07-31c8-4f23-b815-1cf422605b14 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.268966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.269215] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c86bfa9-3823-477c-a644-2010c24241ff with status ACTIVE [ 1076.269727] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.269727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.269727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.269727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.269920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.270299] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.270299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.270299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.270488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.270488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.270618] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.270723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.270787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.270928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.271030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.271194] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c86bfa9-3823-477c-a644-2010c24241ff is going to be updated. [ 1076.296581] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.296581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.296581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.296882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.296984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.297144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c86bfa9-3823-477c-a644-2010c24241ff" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.413186] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.413373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.413373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.413574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.413664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.413853] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.413951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.414024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.414178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.414256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.414341] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1076.445011] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.445253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.445366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.445602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.445792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.463340] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1076.633572] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.633728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.633797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.634135] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.634135] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.634269] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 is going to be updated. [ 1076.662246] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.662530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.662530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.662649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.662797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.672495] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: IN_PROGRESS for 2s [ 1076.773457] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b0a0dd07-31c8-4f23-b815-1cf422605b14',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.276208] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.276669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.276669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.276669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.276808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.276944] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 is going to be created. [ 1077.306042] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.306244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.306244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.306507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.306715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.318016] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 in Status: UNINITIALIZED for 2s [ 1077.626951] env[67003]: INFO networking_nsxv3.common.synchronization [req-a8cd56f6-bbb2-47fa-a2d6-e0d75776e7bb req-976dce85-53a9-4001-80d8-ecaa37c125cb tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1077.626951] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1077.626951] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.627179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.627179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.627343] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.627509] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.627609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.627816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.628079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.628178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.628278] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.964300] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.964527] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.964688] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.964932] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.965209] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.965373] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.965494] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.965757] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.965912] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.966141] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.966256] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.966367] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.966475] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.966585] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.966720] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.966859] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.985216] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.985415] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.985583] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.985770] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.986096] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-6a221056-508d-41f2-a824-198d080d0787 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.986281] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-6a221056-508d-41f2-a824-198d080d0787" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.986396] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-6a221056-508d-41f2-a824-198d080d0787" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.986763] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-6a221056-508d-41f2-a824-198d080d0787" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.986912] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a221056-508d-41f2-a824-198d080d0787',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.130697] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.474504] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1078.474881] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 deletion is rescheduled due to dependency. [ 1078.474881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.490019] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.490019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.490019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.490019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.490281] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.490389] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 6a221056-508d-41f2-a824-198d080d0787 not found, creating... [ 1078.490608] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.490763] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.491550] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.491550] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.492978] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.493568] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.494854] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.494854] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.494854] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.494854] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.494854] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 6a221056-508d-41f2-a824-198d080d0787 is going to be created. [ 1078.518394] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.518595] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.518727] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.519045] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.519294] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.519560] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-6a221056-508d-41f2-a824-198d080d0787" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.633364] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.682513] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: IN_PROGRESS for 4s [ 1079.135624] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.135624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.135906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.135946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.136032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.136126] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1079.164014] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.164209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.164267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.164469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.164735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.175013] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1079.216092] env[67003]: INFO networking_nsxv3.common.synchronization [req-a8cd56f6-bbb2-47fa-a2d6-e0d75776e7bb req-b7f3cbf4-fa66-4a14-a452-de5a8e93cb61 service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1079.216745] env[67003]: INFO networking_nsxv3.common.synchronization [req-a8cd56f6-bbb2-47fa-a2d6-e0d75776e7bb req-b7f3cbf4-fa66-4a14-a452-de5a8e93cb61 service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1079.216951] env[67003]: INFO networking_nsxv3.common.synchronization [req-a8cd56f6-bbb2-47fa-a2d6-e0d75776e7bb req-b7f3cbf4-fa66-4a14-a452-de5a8e93cb61 service nova] Enqueued Resource ID: 6a221056-508d-41f2-a824-198d080d0787 with Priority: HIGHEST for action port [ 1079.217539] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1079.217703] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1079.217843] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a221056-508d-41f2-a824-198d080d0787 with Priority: HIGHEST for action port [ 1079.218120] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.218233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.218331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.218506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.218585] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.219502] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.219594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.219803] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-6a221056-508d-41f2-a824-198d080d0787 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.219944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6a221056-508d-41f2-a824-198d080d0787" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.220027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6a221056-508d-41f2-a824-198d080d0787" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.220215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6a221056-508d-41f2-a824-198d080d0787" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.220215] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6a221056-508d-41f2-a824-198d080d0787',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.328253] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 in Status: SUCCESS [ 1079.328475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.328647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.328858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.329089] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.329217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.329284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.329437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.329585] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.329637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.329719] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b0a0dd07-31c8-4f23-b815-1cf422605b14',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.722053] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.722484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.725085] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6a221056-508d-41f2-a824-198d080d0787 with status ACTIVE [ 1079.725293] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.725423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.725774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.725774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.725918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.725977] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.726098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.726184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.726352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.726406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.726575] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.726732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.726788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.726925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.727012] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.727100] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6a221056-508d-41f2-a824-198d080d0787 is going to be updated. [ 1079.775310] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.775531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.775531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.775790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.776056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.776267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6a221056-508d-41f2-a824-198d080d0787" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.832181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0a0dd07-31c8-4f23-b815-1cf422605b14 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.832447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.832447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.832651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.832842] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.832954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.833025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.833211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.833298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.833400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.833556] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0a0dd07-31c8-4f23-b815-1cf422605b14 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.833667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.833733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.833881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.834041] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.834149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.834221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.834367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.834453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.834559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.834653] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b0a0dd07-31c8-4f23-b815-1cf422605b14',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.336908] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b0a0dd07-31c8-4f23-b815-1cf422605b14: rpc.has_security_group_logging(os_id): False [ 1080.357044] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.357044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.357044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.357044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.357615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.357615] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.357615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.357615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.357936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.357936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.358195] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.358327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.358412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.358598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.358688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.358887] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.358983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.359075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.359258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.359356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.359489] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 is going to be created. [ 1080.421269] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.421412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.421570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.421698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.421881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.432927] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 in Status: IN_PROGRESS for 2s [ 1080.693104] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: SUCCESS [ 1080.693327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.693470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.693692] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.693926] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.694059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.694128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.694284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.694363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.694492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.694587] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.186652] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1081.187075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.187288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.187528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.187726] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.187924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.187987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.188143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.188231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.188337] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.197272] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.691341] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.701069] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e7a3c46b-3fe8-4a52-b683-e71e757f6303: rpc.has_security_group_logging(os_id): False [ 1081.723057] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.723057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.723057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.723281] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.723281] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.723677] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.723677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.723677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.723863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.723863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.723939] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 is going to be updated. [ 1081.812158] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.812382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.812530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.812798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.812980] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.830406] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: IN_PROGRESS for 2s [ 1082.194241] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.213672] env[67003]: INFO networking_nsxv3.common.synchronization [None req-80666e68-cfea-4055-9e1b-da53c2b2df3b tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1082.214393] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1082.214749] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.214877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.214942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.215656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.215962] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.215962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.215962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.216481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.216624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.216815] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.447400] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 in Status: SUCCESS [ 1082.447400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.697890] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.697890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.697890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.698137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.698236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.698347] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1082.718543] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.718795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.718795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.719047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.719167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.719388] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.719513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.719575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.719782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.719867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.719961] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be deleted. [ 1082.737988] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.738193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.738282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.738523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.738710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.748142] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1082.771528] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.771713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.771799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.772101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.772219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.772345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.845611] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: SUCCESS [ 1083.845962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.758406] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1084.758622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.758794] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.759148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.759421] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.759559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.759631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.759823] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.759914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.760027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.760327] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.263586] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.264054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.264054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.264054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.264308] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.264401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.264401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.264575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.264732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.264891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.264944] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.265055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.265326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.265471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.265620] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.265720] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.265807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.265925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.266014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.266113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.266204] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.768992] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f76f58af-f507-4428-b198-11ce6caf814d: rpc.has_security_group_logging(os_id): False [ 1085.791327] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.791327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.791327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.791327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.791327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.791327] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.791327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.791327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.791327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.791327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.792128] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.792128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.792128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.792323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.792416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.792612] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.792700] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.792791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.792935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.793020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.793104] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1085.860454] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.860711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.860831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.861117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.861426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.879182] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1087.215348] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1087.215678] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1087.899409] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1087.899782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.779351] env[67003]: INFO networking_nsxv3.common.synchronization [req-cd5fe778-e915-468f-92f8-5fafbff1180b req-ea6e17d8-8f70-4051-b611-7dc8db9ba853 tempest-InstanceActionsV221TestJSON-422956372 tempest-InstanceActionsV221TestJSON-422956372-project-member] Enqueued Resource ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 with Priority: HIGHEST for action security_group_members [ 1088.779966] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 with Priority: HIGHEST for action security_group_members [ 1088.780308] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-b0a0dd07-31c8-4f23-b815-1cf422605b14 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.780450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.780529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.780743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.780955] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.781043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.781087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.781205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.781286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.781379] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b0a0dd07-31c8-4f23-b815-1cf422605b14',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1089.283805] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.284063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.284063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.284276] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.284365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.284585] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.284866] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.284948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.285171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.285304] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.285383] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 is going to be updated. [ 1089.313905] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1089.314182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1089.314182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1089.314407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1089.314566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.326231] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 in Status: IN_PROGRESS for 2s [ 1090.873661] env[67003]: INFO networking_nsxv3.common.synchronization [req-5cce6102-7b9f-497e-8bd8-1f625c2c2e48 req-95a9dd7d-2d24-4e9d-ae2d-94d67632d56e tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1090.874363] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1090.874839] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.875018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.875136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.875373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.875594] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.875757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.875828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.876113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.876253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.876492] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.336784] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 in Status: SUCCESS [ 1091.337014] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b0a0dd07-31c8-4f23-b815-1cf422605b14 deletion is rescheduled due to dependency. [ 1091.337133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b0a0dd07-31c8-4f23-b815-1cf422605b14" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.380714] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.882887] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.385466] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.385628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.385705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.386278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.386278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.386278] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1092.417205] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.417437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.417437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.419220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.419220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.428143] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1093.869311] env[67003]: INFO networking_nsxv3.common.synchronization [req-dfedf2d7-b0fe-4d67-ab40-66def3bdb2eb req-8b37afb5-b769-4314-b6ca-ec6ea0ecc0d5 tempest-DeleteServersTestJSON-1342989894 tempest-DeleteServersTestJSON-1342989894-project-member] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1093.869311] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1093.870126] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.870649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.870649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.870649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.870874] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.871075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.871118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.871347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.871526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.871919] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.205940] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-521 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.206179] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.206279] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.206530] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.206805] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.206976] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.207074] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.207283] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.207428] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.207633] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.207746] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1094.207901] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1094.208041] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1094.208262] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1094.208387] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1094.208521] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1094.227481] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1094.227662] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1094.227829] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1094.228057] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-521" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.228377] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-b261e49a-bc99-4d66-872f-73f83d0e0ecb taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.228560] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-b261e49a-bc99-4d66-872f-73f83d0e0ecb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.228695] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-b261e49a-bc99-4d66-872f-73f83d0e0ecb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.229033] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-b261e49a-bc99-4d66-872f-73f83d0e0ecb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.229177] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b261e49a-bc99-4d66-872f-73f83d0e0ecb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.374397] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.374615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.374615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.374850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.374956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.375187] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.375303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.375365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.375575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.375671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.375781] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1094.402503] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.402679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.402762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.403057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.403218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.413757] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1094.441251] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1094.441554] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.731947] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.732240] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.732376] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.732674] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.732829] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.732992] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port b261e49a-bc99-4d66-872f-73f83d0e0ecb not found, creating... [ 1094.733301] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.734028] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.734028] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.734028] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.734293] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.734577] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.734813] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.734947] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.735159] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.735296] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.735444] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: b261e49a-bc99-4d66-872f-73f83d0e0ecb is going to be created. [ 1094.792278] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.792531] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.792664] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.792972] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.793286] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.793584] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-b261e49a-bc99-4d66-872f-73f83d0e0ecb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.454426] env[67003]: INFO networking_nsxv3.common.synchronization [req-dfedf2d7-b0fe-4d67-ab40-66def3bdb2eb req-506b4da4-d911-4300-8e56-0658340f5cfa service nova] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_rules [ 1095.454715] env[67003]: INFO networking_nsxv3.common.synchronization [req-dfedf2d7-b0fe-4d67-ab40-66def3bdb2eb req-506b4da4-d911-4300-8e56-0658340f5cfa service nova] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1095.454829] env[67003]: INFO networking_nsxv3.common.synchronization [req-dfedf2d7-b0fe-4d67-ab40-66def3bdb2eb req-506b4da4-d911-4300-8e56-0658340f5cfa service nova] Enqueued Resource ID: b261e49a-bc99-4d66-872f-73f83d0e0ecb with Priority: HIGHEST for action port [ 1095.456150] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_rules [ 1095.456258] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1095.456363] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b261e49a-bc99-4d66-872f-73f83d0e0ecb with Priority: HIGHEST for action port [ 1095.456635] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.456757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.456886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.457173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.457280] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.458252] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.458387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.458593] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b261e49a-bc99-4d66-872f-73f83d0e0ecb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.458808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b261e49a-bc99-4d66-872f-73f83d0e0ecb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.458808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b261e49a-bc99-4d66-872f-73f83d0e0ecb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.459042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b261e49a-bc99-4d66-872f-73f83d0e0ecb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.459145] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b261e49a-bc99-4d66-872f-73f83d0e0ecb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.960507] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.960652] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.961988] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b261e49a-bc99-4d66-872f-73f83d0e0ecb with status ACTIVE [ 1095.962202] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.962363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.962435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.962639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.963254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.963254] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.963254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.963254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.963254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.963579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.963579] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.963579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.963694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.963764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.963845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.963941] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b261e49a-bc99-4d66-872f-73f83d0e0ecb is going to be updated. [ 1096.003870] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.004076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.004150] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.004355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.004495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.004658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b261e49a-bc99-4d66-872f-73f83d0e0ecb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.423895] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1096.423895] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 deletion is rescheduled due to dependency. [ 1096.423895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.423895] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.424232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.424232] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.424331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.424331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.424497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.424602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.424666] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.928525] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.431051] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.933466] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.933796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.933796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.935141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.935141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.935141] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1097.969610] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.969811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.969871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.970128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.970234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.980029] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1099.827151] env[67003]: INFO networking_nsxv3.common.synchronization [None req-8ca6576a-fbf3-43a5-aca1-79806abbdecf None None] Enqueued Resource ID: f8b3912a-c9f4-4c1d-ace7-b33b634d212c with Priority: HIGHEST for action port [ 1099.827151] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f8b3912a-c9f4-4c1d-ace7-b33b634d212c with Priority: HIGHEST for action port [ 1099.829055] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-f8b3912a-c9f4-4c1d-ace7-b33b634d212c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.831122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f8b3912a-c9f4-4c1d-ace7-b33b634d212c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.831122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f8b3912a-c9f4-4c1d-ace7-b33b634d212c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.831122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f8b3912a-c9f4-4c1d-ace7-b33b634d212c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.831122] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f8b3912a-c9f4-4c1d-ace7-b33b634d212c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.992067] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1099.992300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.992536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.992832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.993075] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.993199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.993259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.993423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.993503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.993681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.993777] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.333213] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f8b3912a-c9f4-4c1d-ace7-b33b634d212c [ 1100.333450] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.333586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.333695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.333947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.334207] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.334377] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f8b3912a-c9f4-4c1d-ace7-b33b634d212c already deleted. [ 1100.334517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f8b3912a-c9f4-4c1d-ace7-b33b634d212c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.497038] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.497038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.497038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.497404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.497404] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.497404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.497404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.497607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.497652] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.497706] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.497868] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.497965] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.498052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.498172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.498311] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.498405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.498465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.498599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.499082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.499082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.499082] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.001617] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 06d182ef-21b7-44fd-8cbf-2f35f7927435: rpc.has_security_group_logging(os_id): False [ 1101.029937] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.030170] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.030170] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.030553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.030553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.030716] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.031327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.031327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.031327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.031327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.031577] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.031577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.031577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.031761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.031761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.031964] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.032047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.032047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.032193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.032269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.032354] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1101.076362] env[67003]: INFO networking_nsxv3.common.synchronization [req-1e977da9-5c7d-4c55-b481-f17b73bac315 req-b6bc8f34-72b9-4acc-836d-853b90555992 tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGHEST for action security_group_members [ 1101.077082] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGHEST for action security_group_members [ 1101.077434] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55815927-bbca-4dbc-be18-77001e3e9c6b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.077545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.077622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.078816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.078816] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.078816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.078816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.078816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.078816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.078816] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55815927-bbca-4dbc-be18-77001e3e9c6b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.119950] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.120318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.120318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.120471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.120918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.141066] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1101.580335] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.580598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.580598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.580878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.652081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.652081] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.652081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.652081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.652081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.652081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.652081] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55815927-bbca-4dbc-be18-77001e3e9c6b is going to be updated. [ 1101.652081] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.652081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.652081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.652081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.652081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.663859] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55815927-bbca-4dbc-be18-77001e3e9c6b in Status: IN_PROGRESS for 2s [ 1101.883689] env[67003]: INFO networking_nsxv3.common.synchronization [req-b95f1686-b454-40ad-bc7f-8d22c91acb68 req-e3281c2c-1c52-47b7-b50f-dadd0fa7572e tempest-ServerRescueNegativeTestJSON-408866913 tempest-ServerRescueNegativeTestJSON-408866913-project-member] Enqueued Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGHEST for action security_group_members [ 1101.884475] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGHEST for action security_group_members [ 1101.884840] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4cad76eb-924a-41f1-b865-f281dc96cec6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.884964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.885224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.885270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.885406] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.885506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.885578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.885710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.885790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.886166] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.267871] env[67003]: INFO networking_nsxv3.common.synchronization [None req-7eeec123-6ea6-4394-bf39-f4ec6000acfc None None] Enqueued Resource ID: 86d20d22-25ae-4443-8c68-1340086a5f2f with Priority: HIGHEST for action port [ 1102.268355] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86d20d22-25ae-4443-8c68-1340086a5f2f with Priority: HIGHEST for action port [ 1102.268979] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-86d20d22-25ae-4443-8c68-1340086a5f2f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.269125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86d20d22-25ae-4443-8c68-1340086a5f2f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.269221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86d20d22-25ae-4443-8c68-1340086a5f2f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.269466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86d20d22-25ae-4443-8c68-1340086a5f2f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.269548] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86d20d22-25ae-4443-8c68-1340086a5f2f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.390132] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.390132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.390132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.390132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.390132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.390132] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.390422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.390422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.390422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.390493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.390655] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 is going to be updated. [ 1102.420521] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.420654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.420725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.420936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.421098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.433159] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 in Status: IN_PROGRESS for 2s [ 1102.772023] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86d20d22-25ae-4443-8c68-1340086a5f2f [ 1102.772215] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.772367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.772451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.772705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.772819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.772924] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86d20d22-25ae-4443-8c68-1340086a5f2f already deleted. [ 1102.773014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86d20d22-25ae-4443-8c68-1340086a5f2f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.160097] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1103.160377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.675029] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55815927-bbca-4dbc-be18-77001e3e9c6b in Status: SUCCESS [ 1103.675329] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55815927-bbca-4dbc-be18-77001e3e9c6b deletion is rescheduled due to dependency. [ 1103.675329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.443672] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 in Status: SUCCESS [ 1104.443672] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 deletion is rescheduled due to dependency. [ 1104.443828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.686604] env[67003]: INFO networking_nsxv3.common.synchronization [req-552df66f-abca-4cab-9fb4-d218267e7f76 req-921de813-d374-41ca-9c78-73ee8da78a9b tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1106.687209] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1106.687520] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.688834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.689881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.690324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.690324] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.690735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.690735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.690735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.690735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.692814] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.014149] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.014464] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.014596] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.014880] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.015184] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.015349] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.015465] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.015677] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.015818] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.016077] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.016207] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.016317] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.016433] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.016545] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.016649] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.016809] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.037699] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.037895] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.038108] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.038297] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.038609] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-2acaa58c-b8bc-4c38-a253-bb3204d5ed51 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.038786] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-2acaa58c-b8bc-4c38-a253-bb3204d5ed51" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.038905] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-2acaa58c-b8bc-4c38-a253-bb3204d5ed51" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.039249] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-2acaa58c-b8bc-4c38-a253-bb3204d5ed51" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.039387] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2acaa58c-b8bc-4c38-a253-bb3204d5ed51',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.193568] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.541344] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.541563] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.541688] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.541955] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.542145] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.542304] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 2acaa58c-b8bc-4c38-a253-bb3204d5ed51 not found, creating... [ 1107.542560] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.542714] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.542828] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.543074] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.543206] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.543474] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.543623] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.543737] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.543938] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.544084] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.544220] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 2acaa58c-b8bc-4c38-a253-bb3204d5ed51 is going to be created. [ 1107.563171] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.563371] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.563493] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.563743] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.563971] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.564205] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-2acaa58c-b8bc-4c38-a253-bb3204d5ed51" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.696203] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.199969] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.200139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.200209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.200416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.200505] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.200600] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1108.232323] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.232475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.232556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.232744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.232887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.242266] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1108.266051] env[67003]: INFO networking_nsxv3.common.synchronization [req-552df66f-abca-4cab-9fb4-d218267e7f76 req-7adbf9ac-ef70-4e3b-8c0d-69339d8f43d9 service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1108.266051] env[67003]: INFO networking_nsxv3.common.synchronization [req-552df66f-abca-4cab-9fb4-d218267e7f76 req-7adbf9ac-ef70-4e3b-8c0d-69339d8f43d9 service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1108.266051] env[67003]: INFO networking_nsxv3.common.synchronization [req-552df66f-abca-4cab-9fb4-d218267e7f76 req-7adbf9ac-ef70-4e3b-8c0d-69339d8f43d9 service nova] Enqueued Resource ID: 2acaa58c-b8bc-4c38-a253-bb3204d5ed51 with Priority: HIGHEST for action port [ 1108.266051] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1108.266051] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1108.266573] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2acaa58c-b8bc-4c38-a253-bb3204d5ed51 with Priority: HIGHEST for action port [ 1108.267075] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.267313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.267476] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.267754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.268049] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.268966] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.269256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.269545] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2acaa58c-b8bc-4c38-a253-bb3204d5ed51 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.269753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2acaa58c-b8bc-4c38-a253-bb3204d5ed51" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.269906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2acaa58c-b8bc-4c38-a253-bb3204d5ed51" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.270594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2acaa58c-b8bc-4c38-a253-bb3204d5ed51" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.270594] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2acaa58c-b8bc-4c38-a253-bb3204d5ed51',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.772614] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2acaa58c-b8bc-4c38-a253-bb3204d5ed51 with status ACTIVE [ 1108.772893] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.773009] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.773067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.773272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.773365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.773551] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.773643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.774340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.774340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.774340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.774340] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.774340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.774340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.774530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.774530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.774530] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2acaa58c-b8bc-4c38-a253-bb3204d5ed51 is going to be updated. [ 1108.775782] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.776428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.796531] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.796531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.796531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.796531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.796531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.797028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2acaa58c-b8bc-4c38-a253-bb3204d5ed51" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.054050] env[67003]: INFO networking_nsxv3.common.synchronization [req-7b77d870-11a5-49a9-afbb-c5e7255bea62 req-43cab580-5b9d-49e9-b318-452e2847fc73 tempest-ServerRescueTestJSON-1581036954 tempest-ServerRescueTestJSON-1581036954-project-member] Enqueued Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_members [ 1109.054696] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_members [ 1109.055130] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.055443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.055443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.055675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.055872] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.055996] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.056097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.056280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.056394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.056505] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.362890] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-998 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.362890] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-998" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.363055] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-998" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.363339] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-998" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.363597] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.363761] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.363894] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.364099] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.364249] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.364456] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.364568] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.364677] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.364787] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.364895] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.365007] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.365146] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.383105] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.384226] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1109.384226] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.384226] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-998" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.384226] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-70b214a2-b77e-4901-8a99-1da237eebb28 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.384226] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-70b214a2-b77e-4901-8a99-1da237eebb28" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.384226] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-70b214a2-b77e-4901-8a99-1da237eebb28" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.384606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-70b214a2-b77e-4901-8a99-1da237eebb28" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.384743] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70b214a2-b77e-4901-8a99-1da237eebb28',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.558511] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.558668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.558742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.558951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.559113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.559376] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.559487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.559578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.559767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.560132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.560132] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 already deleted. [ 1109.560132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.888893] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.889305] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.889530] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.889956] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.890151] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.890308] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 70b214a2-b77e-4901-8a99-1da237eebb28 not found, creating... [ 1109.890627] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.890804] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.890925] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.891243] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.891311] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.891590] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.891768] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.891890] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.892137] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.892301] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.892443] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 70b214a2-b77e-4901-8a99-1da237eebb28 is going to be created. [ 1109.912794] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.913974] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.913974] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.913974] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.913974] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.913974] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-70b214a2-b77e-4901-8a99-1da237eebb28" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.252834] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1110.254129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.254129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.254129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.254129] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.254129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.254129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.254645] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.254645] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.254645] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.595617] env[67003]: INFO networking_nsxv3.common.synchronization [req-7b77d870-11a5-49a9-afbb-c5e7255bea62 req-e5e97fc4-8c71-4464-9fff-22234d2b1b13 service nova] Enqueued Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_rules [ 1110.595885] env[67003]: INFO networking_nsxv3.common.synchronization [req-7b77d870-11a5-49a9-afbb-c5e7255bea62 req-e5e97fc4-8c71-4464-9fff-22234d2b1b13 service nova] Enqueued Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_members [ 1110.596207] env[67003]: INFO networking_nsxv3.common.synchronization [req-7b77d870-11a5-49a9-afbb-c5e7255bea62 req-e5e97fc4-8c71-4464-9fff-22234d2b1b13 service nova] Enqueued Resource ID: 70b214a2-b77e-4901-8a99-1da237eebb28 with Priority: HIGHEST for action port [ 1110.596952] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_rules [ 1110.597523] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_members [ 1110.597680] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70b214a2-b77e-4901-8a99-1da237eebb28 with Priority: HIGHEST for action port [ 1110.598107] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.598273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.598387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.598740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.599094] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.600322] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.601062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.601062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.601062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.601062] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.601345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.601345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.601466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.601590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.601721] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.603194] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-70b214a2-b77e-4901-8a99-1da237eebb28 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.603313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70b214a2-b77e-4901-8a99-1da237eebb28" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.603461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70b214a2-b77e-4901-8a99-1da237eebb28" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.603654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70b214a2-b77e-4901-8a99-1da237eebb28" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.604066] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70b214a2-b77e-4901-8a99-1da237eebb28',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.756835] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.106124] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.106464] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.106499] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.107496] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70b214a2-b77e-4901-8a99-1da237eebb28 with status ACTIVE [ 1111.107700] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.107929] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.108123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.108358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.108450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.108626] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.108725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.108787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.108931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.109013] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.109525] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.109624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.109688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.109831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.109908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.110000] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70b214a2-b77e-4901-8a99-1da237eebb28 is going to be updated. [ 1111.136276] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.136447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.136504] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.136683] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.136818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.137029] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70b214a2-b77e-4901-8a99-1da237eebb28" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.187819] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.188155] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.188316] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.188593] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.188863] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.189037] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.189164] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.189400] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.189543] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.189794] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.190066] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.190280] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.190386] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.190538] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.190669] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.190850] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.212593] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.212807] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1111.212963] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.213177] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.213558] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-334b1fdf-696f-44af-bee4-13c456a36c06 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.213792] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.213920] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.214318] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.214464] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('334b1fdf-696f-44af-bee4-13c456a36c06',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.258874] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.612258] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.716852] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.717189] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.717356] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.717608] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.717760] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.717939] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 334b1fdf-696f-44af-bee4-13c456a36c06 not found, creating... [ 1111.718256] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.718438] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.718557] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.718965] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.718965] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.719267] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.719425] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.719542] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.719751] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.719906] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.720096] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 334b1fdf-696f-44af-bee4-13c456a36c06 is going to be created. [ 1111.742326] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.742541] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.742669] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.742939] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.743368] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.743486] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.760987] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.761202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.761311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.761698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.761820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.762343] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1111.806612] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.806766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.806838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.807109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.807268] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.835200] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1112.115065] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.115452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.115452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.115452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.115594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.115644] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 is going to be created. [ 1112.142095] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.142342] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.142434] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.142649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.142828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.153886] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: UNINITIALIZED for 2s [ 1112.448390] env[67003]: INFO networking_nsxv3.common.synchronization [req-44bc9dbb-dff2-41eb-9d64-0293b4155b88 req-3e7eacee-907f-4f01-830d-600e9781850a service nova] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_rules [ 1112.448625] env[67003]: INFO networking_nsxv3.common.synchronization [req-44bc9dbb-dff2-41eb-9d64-0293b4155b88 req-3e7eacee-907f-4f01-830d-600e9781850a service nova] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1112.448772] env[67003]: INFO networking_nsxv3.common.synchronization [req-44bc9dbb-dff2-41eb-9d64-0293b4155b88 req-3e7eacee-907f-4f01-830d-600e9781850a service nova] Enqueued Resource ID: 334b1fdf-696f-44af-bee4-13c456a36c06 with Priority: HIGHEST for action port [ 1112.449359] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_rules [ 1112.449501] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1112.449602] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334b1fdf-696f-44af-bee4-13c456a36c06 with Priority: HIGHEST for action port [ 1112.449881] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.450047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.450159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.450545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.450606] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.452473] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.452676] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.452791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.453147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.453404] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.453663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.453803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.454128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.454440] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.454440] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.456712] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-334b1fdf-696f-44af-bee4-13c456a36c06 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.456712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.456712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.456712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.456712] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('334b1fdf-696f-44af-bee4-13c456a36c06',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.959039] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 334b1fdf-696f-44af-bee4-13c456a36c06 with status ACTIVE [ 1112.959399] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.959537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.959658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.960028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.960184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.960464] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.960657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.960764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.961025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.961127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.961901] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.961901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.961901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.961901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.961901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.962147] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 334b1fdf-696f-44af-bee4-13c456a36c06 is going to be updated. [ 1112.963407] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.964478] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.964911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.985745] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.985933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.986014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.986233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.986372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.986529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.467081] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.848092] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1113.848092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.848092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.848604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.848604] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.848745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.848789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.848940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.849032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.849129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.849276] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.971150] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.971419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.971513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.971812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.971915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.971995] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be created. [ 1114.008304] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.008478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.008549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.008797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.008994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.020563] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: UNINITIALIZED for 2s [ 1114.166155] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: SUCCESS [ 1114.166380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.166578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.166967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.167191] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.167364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.167450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.167646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.167731] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.167839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.167959] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.351958] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.351958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.351958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.351958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.351958] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.351958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.352253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.352253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.352312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.352363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.352511] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.352618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.352680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.352820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.352956] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.353060] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.353392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.353392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.353392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.353392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.353533] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.670862] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.671247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.671247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.671381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.671567] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.671643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.671704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.671843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.671930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.672035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.672183] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.672297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.672382] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.672535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.672678] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.672773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.672830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.672968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.673068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.673154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.673248] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.856860] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f76f58af-f507-4428-b198-11ce6caf814d: rpc.has_security_group_logging(os_id): False [ 1114.901983] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.902143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.902450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.902543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.902590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.902928] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.903072] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.903144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.903322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.903411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.903664] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.903739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.903791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.903940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.904167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.904468] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.904623] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.904733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.905157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.905157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.905157] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1114.995341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.995530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.995668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.995828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.995979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.016028] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1115.175438] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62aff8a2-792c-4df1-90fb-88b44b18cc02: rpc.has_security_group_logging(os_id): False [ 1115.204432] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.204753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.204948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.205158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.205297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.205679] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.205817] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.205940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.206191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.206363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.206670] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.206838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.206948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.207188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.207321] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.207631] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.207792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.207897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.208148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.208283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.208464] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 is going to be created. [ 1115.290243] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.290471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.290471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.290691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.290873] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.305226] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: IN_PROGRESS for 2s [ 1115.854117] env[67003]: INFO networking_nsxv3.common.synchronization [req-b0c1342a-7b56-440a-8979-657b6ec3a559 req-5992b33f-3611-43a2-bec0-acd8dcbb005d tempest-AttachInterfacesUnderV243Test-564471411 tempest-AttachInterfacesUnderV243Test-564471411-project-member] Enqueued Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1115.854659] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1115.855528] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.855528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.855528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.855789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.855889] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.855994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.856067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.856225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.856322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.856404] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.882995] env[67003]: INFO networking_nsxv3.common.synchronization [req-b0c1342a-7b56-440a-8979-657b6ec3a559 req-5992b33f-3611-43a2-bec0-acd8dcbb005d tempest-AttachInterfacesUnderV243Test-564471411 tempest-AttachInterfacesUnderV243Test-564471411-project-member] Enqueued Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_rules [ 1115.883501] env[67003]: INFO networking_nsxv3.common.synchronization [req-b0c1342a-7b56-440a-8979-657b6ec3a559 req-5992b33f-3611-43a2-bec0-acd8dcbb005d tempest-AttachInterfacesUnderV243Test-564471411 tempest-AttachInterfacesUnderV243Test-564471411-project-member] Enqueued Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1115.883501] env[67003]: INFO networking_nsxv3.common.synchronization [req-b0c1342a-7b56-440a-8979-657b6ec3a559 req-5992b33f-3611-43a2-bec0-acd8dcbb005d tempest-AttachInterfacesUnderV243Test-564471411 tempest-AttachInterfacesUnderV243Test-564471411-project-member] Enqueued Resource ID: 458629a3-fe57-4d5b-9786-c958c3c43d38 with Priority: HIGHEST for action port [ 1115.884067] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_rules [ 1115.884279] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1115.884424] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458629a3-fe57-4d5b-9786-c958c3c43d38 with Priority: HIGHEST for action port [ 1115.884893] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.884893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.884893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.886302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.886302] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.887270] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.887270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.887400] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-458629a3-fe57-4d5b-9786-c958c3c43d38 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.887510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.887579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.887869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.887917] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('458629a3-fe57-4d5b-9786-c958c3c43d38',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.030672] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 1116.030894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.031078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.031301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.031519] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.031645] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.031711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.031876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.031958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.032065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.032158] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.358963] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.389642] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.389811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.390627] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 458629a3-fe57-4d5b-9786-c958c3c43d38 with status ACTIVE [ 1116.390627] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.390627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.390627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.390627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.390627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.390877] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.390877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.390877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.390977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.391062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.391205] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.391293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.391416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.391482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.391552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.392689] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 458629a3-fe57-4d5b-9786-c958c3c43d38 is going to be updated. [ 1116.414191] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.414336] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.414410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.414608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.414908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.415172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.534367] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.534563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.534997] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.535260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.535444] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.535551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.535610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.535757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.535840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.535926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.536091] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.536186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.536246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.536387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.536859] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.536859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.536859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.536859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.536859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.537098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.537098] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.862189] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.036751] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1117.036980] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.039413] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a: rpc.has_security_group_logging(os_id): False [ 1117.061827] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.061990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.062067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.062291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.062384] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.062602] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.062703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.062767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.063073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.063073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.063292] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.063452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.063561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.063782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.063903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.064141] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.064240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.064302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.064446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.064521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.064605] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be created. [ 1117.138236] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.138453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.138453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.138639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.138812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.172251] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: IN_PROGRESS for 2s [ 1117.320372] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: SUCCESS [ 1117.320715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.365527] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.365708] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.365851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.365979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.366055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.366169] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a013f0-b993-4dc2-8d6d-063c011d939f is going to be updated. [ 1117.397785] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.398066] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.398066] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.398257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.398415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.410089] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a013f0-b993-4dc2-8d6d-063c011d939f in Status: IN_PROGRESS for 2s [ 1118.952556] env[67003]: INFO networking_nsxv3.common.synchronization [req-9d3ad3ba-59da-4044-bb4b-aa5d99a76041 req-ea169f32-87a2-41ac-9209-7338a00fe5c0 tempest-AttachInterfacesUnderV243Test-564471411 tempest-AttachInterfacesUnderV243Test-564471411-project-member] Enqueued Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1118.954789] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1118.955366] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.955366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.970137] env[67003]: INFO networking_nsxv3.common.synchronization [req-9d3ad3ba-59da-4044-bb4b-aa5d99a76041 req-ea169f32-87a2-41ac-9209-7338a00fe5c0 tempest-AttachInterfacesUnderV243Test-564471411 tempest-AttachInterfacesUnderV243Test-564471411-project-member] Enqueued Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_rules [ 1118.970335] env[67003]: INFO networking_nsxv3.common.synchronization [req-9d3ad3ba-59da-4044-bb4b-aa5d99a76041 req-ea169f32-87a2-41ac-9209-7338a00fe5c0 tempest-AttachInterfacesUnderV243Test-564471411 tempest-AttachInterfacesUnderV243Test-564471411-project-member] Enqueued Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1118.970479] env[67003]: INFO networking_nsxv3.common.synchronization [req-9d3ad3ba-59da-4044-bb4b-aa5d99a76041 req-ea169f32-87a2-41ac-9209-7338a00fe5c0 tempest-AttachInterfacesUnderV243Test-564471411 tempest-AttachInterfacesUnderV243Test-564471411-project-member] Enqueued Resource ID: 458629a3-fe57-4d5b-9786-c958c3c43d38 with Priority: HIGHEST for action port [ 1118.970991] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_rules [ 1118.971209] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1118.971272] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 458629a3-fe57-4d5b-9786-c958c3c43d38 with Priority: HIGHEST for action port [ 1118.971896] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.971896] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.974911] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.975316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.975316] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-458629a3-fe57-4d5b-9786-c958c3c43d38 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.975401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.975675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.975675] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.975741] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('458629a3-fe57-4d5b-9786-c958c3c43d38',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.191497] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 1119.191749] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.421865] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a013f0-b993-4dc2-8d6d-063c011d939f in Status: SUCCESS [ 1119.421865] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.421865] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.422102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.422359] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.422506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.422570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.422739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.422819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.424232] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.478431] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 458629a3-fe57-4d5b-9786-c958c3c43d38 with status ACTIVE [ 1119.478710] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.478868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.478950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.479194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.479310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.479499] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.479646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.479693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.479838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.479935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.480136] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.480244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.480310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.480450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.480523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.480611] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 458629a3-fe57-4d5b-9786-c958c3c43d38 is going to be updated. [ 1119.504894] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.505086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.505125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.505308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.505450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.505609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-458629a3-fe57-4d5b-9786-c958c3c43d38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.926427] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.304169] env[67003]: INFO networking_nsxv3.common.synchronization [req-dabf8841-2893-43c1-8fd9-5958031162e6 req-92dc326a-4cac-4e26-a588-6fd4c40dc574 tempest-ServerRescueNegativeTestJSON-408866913 tempest-ServerRescueNegativeTestJSON-408866913-project-member] Enqueued Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_members [ 1120.304987] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_members [ 1120.305254] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.305466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.305579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.305868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.306153] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.306324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.306430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.306701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.306838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.307026] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.429717] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.811520] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.932910] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.932910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.932910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.933276] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.933548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.933653] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a013f0-b993-4dc2-8d6d-063c011d939f is going to be updated. [ 1120.981767] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.981931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.981931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.982179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.982354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.995446] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a013f0-b993-4dc2-8d6d-063c011d939f in Status: IN_PROGRESS for 2s [ 1121.316660] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.703347] env[67003]: INFO networking_nsxv3.common.synchronization [req-828d6bce-806f-49e2-8221-b26d490e0702 req-924e0901-b2f6-4213-8115-2b9998cb53cb tempest-ServerActionsTestJSON-1949922754 tempest-ServerActionsTestJSON-1949922754-project-member] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1121.703949] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1121.704409] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.704409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.704409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.704635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.704777] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.704915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.705059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.705134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.705203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.705299] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1121.820466] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.820466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.820566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.820748] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.820835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.820936] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 is going to be updated. [ 1121.858033] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.858033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.858033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.858033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.858033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.873088] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: IN_PROGRESS for 2s [ 1122.208195] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.209406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.209567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.209939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.238120] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.238523] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.238734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.238882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.239143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.239262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.239326] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 is going to be updated. [ 1122.285842] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.286060] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.286173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.286489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.286712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.298245] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: IN_PROGRESS for 2s [ 1123.005641] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a013f0-b993-4dc2-8d6d-063c011d939f in Status: SUCCESS [ 1123.005982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.006134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.006357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.006558] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.006695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.006736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.006889] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.006973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.007132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.007192] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.008095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.008272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.008449] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.008565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.008630] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.008774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.008854] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.008945] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.313674] env[67003]: INFO networking_nsxv3.common.synchronization [req-1313fef7-ec45-4ab9-b3ff-cfda6b8c4423 req-50f65698-ed50-4060-ba4b-c96f3d027b27 tempest-AttachInterfacesUnderV243Test-564471411 tempest-AttachInterfacesUnderV243Test-564471411-project-member] Enqueued Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1123.314245] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28a013f0-b993-4dc2-8d6d-063c011d939f with Priority: HIGHEST for action security_group_members [ 1123.314993] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-28a013f0-b993-4dc2-8d6d-063c011d939f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.315136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.511384] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.512310] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.885071] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: SUCCESS [ 1123.885365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.013811] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 28a013f0-b993-4dc2-8d6d-063c011d939f: rpc.has_security_group_logging(os_id): False [ 1124.015017] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.039862] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.040168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.040368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.040809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.040809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.041058] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.041235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.041336] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.041509] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.041632] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.041877] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28a013f0-b993-4dc2-8d6d-063c011d939f is going to be updated. [ 1124.113889] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.114045] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.114312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.114312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.114451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.119684] env[67003]: INFO networking_nsxv3.common.synchronization [req-72e733f4-d735-482d-8a61-6131a2326ded req-bd444c9c-dc0b-49e8-9863-9710e94d0266 tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_members [ 1124.120295] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_members [ 1124.120606] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.120881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.120881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.120983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.121181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.121614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.121614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.121614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.121614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.121760] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.129999] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28a013f0-b993-4dc2-8d6d-063c011d939f in Status: IN_PROGRESS for 2s [ 1124.312151] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: SUCCESS [ 1124.312364] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 deletion is rescheduled due to dependency. [ 1124.312485] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.458170] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.458386] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.458515] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.458782] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.459160] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.459355] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.459482] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.459683] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.459822] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.460040] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1124.460157] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1124.460267] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1124.460377] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1124.460519] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1124.460705] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1124.460860] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1124.481641] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1124.481866] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1124.482019] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1124.482202] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.482523] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-2418bedd-9d88-482f-a1f8-8b184be2b6af taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.482706] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-2418bedd-9d88-482f-a1f8-8b184be2b6af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.482825] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-2418bedd-9d88-482f-a1f8-8b184be2b6af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.483194] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-2418bedd-9d88-482f-a1f8-8b184be2b6af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.483392] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2418bedd-9d88-482f-a1f8-8b184be2b6af',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.517113] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.517347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.517441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.517625] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.517716] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.517817] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a013f0-b993-4dc2-8d6d-063c011d939f is going to be updated. [ 1124.550048] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.550199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.550272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.550489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.551397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.559900] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a013f0-b993-4dc2-8d6d-063c011d939f in Status: IN_PROGRESS for 2s [ 1124.623499] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.623656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.623760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.624118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.645661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.645931] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.646065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.646135] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.646333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.646428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.646491] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55872268-81d2-4523-87e7-e00ce5194127 is going to be updated. [ 1124.674136] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.674298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.674493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.674743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.674891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.683869] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: IN_PROGRESS for 2s [ 1124.986194] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.986448] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.986578] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.986864] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.987088] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.987257] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 2418bedd-9d88-482f-a1f8-8b184be2b6af not found, creating... [ 1124.987531] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.987686] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.987802] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.988055] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.988229] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.988517] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.988676] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.988794] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.989008] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.989153] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.989330] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 2418bedd-9d88-482f-a1f8-8b184be2b6af is going to be created. [ 1125.013651] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.013858] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.014118] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.014264] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.014499] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.014717] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-2418bedd-9d88-482f-a1f8-8b184be2b6af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.686183] env[67003]: INFO networking_nsxv3.common.synchronization [req-72e733f4-d735-482d-8a61-6131a2326ded req-e320d02d-95e3-4736-9c09-31d9b9229097 service nova] Enqueued Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_rules [ 1125.686406] env[67003]: INFO networking_nsxv3.common.synchronization [req-72e733f4-d735-482d-8a61-6131a2326ded req-e320d02d-95e3-4736-9c09-31d9b9229097 service nova] Enqueued Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_members [ 1125.686562] env[67003]: INFO networking_nsxv3.common.synchronization [req-72e733f4-d735-482d-8a61-6131a2326ded req-e320d02d-95e3-4736-9c09-31d9b9229097 service nova] Enqueued Resource ID: 2418bedd-9d88-482f-a1f8-8b184be2b6af with Priority: HIGHEST for action port [ 1125.687435] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_rules [ 1125.687588] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_members [ 1125.687685] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2418bedd-9d88-482f-a1f8-8b184be2b6af with Priority: HIGHEST for action port [ 1125.693950] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.693950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.693950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.693950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.693950] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.693950] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.693950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.693950] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2418bedd-9d88-482f-a1f8-8b184be2b6af taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.693950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2418bedd-9d88-482f-a1f8-8b184be2b6af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.693950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2418bedd-9d88-482f-a1f8-8b184be2b6af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.693950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2418bedd-9d88-482f-a1f8-8b184be2b6af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.694414] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2418bedd-9d88-482f-a1f8-8b184be2b6af',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.161733] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 28a013f0-b993-4dc2-8d6d-063c011d939f in Status: SUCCESS [ 1126.162067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.163023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.163023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.163023] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.202430] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.202430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.202430] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2418bedd-9d88-482f-a1f8-8b184be2b6af with status ACTIVE [ 1126.202430] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.202430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.202430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.202430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.202430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.202430] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.202430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.202430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.202430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.202430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.202430] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.203251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.203251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.203251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.203251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.203251] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2418bedd-9d88-482f-a1f8-8b184be2b6af is going to be updated. [ 1126.231053] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.231384] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.231456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.231702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.232043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.232043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2418bedd-9d88-482f-a1f8-8b184be2b6af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.552020] env[67003]: INFO networking_nsxv3.common.synchronization [req-4a78379c-98e0-433e-8809-f391740c483b req-f7923705-58ce-4ef9-98a9-dedcdf60f030 tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1126.552671] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1126.552987] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.553187] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.553273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.553893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.554118] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.554267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.554267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.556141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.556141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.556141] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.572223] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 28a013f0-b993-4dc2-8d6d-063c011d939f in Status: SUCCESS [ 1126.572448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.573084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.574471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.574471] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.574471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.574471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.574471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.574471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.574471] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.684728] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.684943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.685267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.685552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.685662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.685786] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 28a013f0-b993-4dc2-8d6d-063c011d939f is going to be deleted. [ 1126.695103] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: IN_PROGRESS for 4s [ 1126.739381] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.739540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.739596] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.739807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.739901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.740033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.876676] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.877105] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.877319] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.877656] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.878219] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.878335] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.878544] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.878811] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.879055] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.879354] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.879547] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.879741] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.880022] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.880145] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.880340] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.880566] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.902221] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.902497] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1126.902652] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.902877] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.903255] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-1045eef4-6f3a-4231-9c69-290209beba35 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.903528] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-1045eef4-6f3a-4231-9c69-290209beba35" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.903586] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-1045eef4-6f3a-4231-9c69-290209beba35" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.903890] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-1045eef4-6f3a-4231-9c69-290209beba35" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.904016] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1045eef4-6f3a-4231-9c69-290209beba35',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.057419] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.078438] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.078624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.078624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.079065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.079065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.079447] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.079447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.079447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.079562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.079643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.079689] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a013f0-b993-4dc2-8d6d-063c011d939f is going to be deleted. [ 1127.127481] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.127760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.127824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.128152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.128301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.128475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.128707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.129443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.129443] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.129665] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.129808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.130069] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.130258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.130453] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('28a013f0-b993-4dc2-8d6d-063c011d939f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.409471] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.410043] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.410160] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.410808] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.411078] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.411420] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 1045eef4-6f3a-4231-9c69-290209beba35 not found, creating... [ 1127.411899] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.412557] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.412795] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.413174] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.413534] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.414078] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.414371] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.414601] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.415295] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.415295] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.416429] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 1045eef4-6f3a-4231-9c69-290209beba35 is going to be created. [ 1127.437287] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.437490] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.437609] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.437885] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.438142] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.438528] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-1045eef4-6f3a-4231-9c69-290209beba35" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.559730] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.633096] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.634061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.634061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.634061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.634345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.634699] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.634952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.635191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.635541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.635743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.635960] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 28a013f0-b993-4dc2-8d6d-063c011d939f already deleted. [ 1127.636182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-28a013f0-b993-4dc2-8d6d-063c011d939f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.066400] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.066567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.066658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.066876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.066948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.067050] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1128.116592] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.116778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.116834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.117088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.117278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.134477] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1128.163322] env[67003]: INFO networking_nsxv3.common.synchronization [req-4a78379c-98e0-433e-8809-f391740c483b req-e51df83e-8a16-4dee-b441-b3396c8b1e08 service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1128.163322] env[67003]: INFO networking_nsxv3.common.synchronization [req-4a78379c-98e0-433e-8809-f391740c483b req-e51df83e-8a16-4dee-b441-b3396c8b1e08 service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1128.163322] env[67003]: INFO networking_nsxv3.common.synchronization [req-4a78379c-98e0-433e-8809-f391740c483b req-e51df83e-8a16-4dee-b441-b3396c8b1e08 service nova] Enqueued Resource ID: 1045eef4-6f3a-4231-9c69-290209beba35 with Priority: HIGHEST for action port [ 1128.164177] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1128.164177] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1128.164257] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1045eef4-6f3a-4231-9c69-290209beba35 with Priority: HIGHEST for action port [ 1128.164724] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.164724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.164724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.164959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.165052] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.165973] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.166094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.167124] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-1045eef4-6f3a-4231-9c69-290209beba35 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.167124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1045eef4-6f3a-4231-9c69-290209beba35" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.167124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1045eef4-6f3a-4231-9c69-290209beba35" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.167124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1045eef4-6f3a-4231-9c69-290209beba35" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.167124] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1045eef4-6f3a-4231-9c69-290209beba35',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.572159] env[67003]: INFO networking_nsxv3.common.synchronization [req-92b21943-b631-4556-af12-f7fe8340a398 req-5bb15d07-f702-4181-ae61-74e8a638bbd2 tempest-AttachVolumeShelveTestJSON-97641738 tempest-AttachVolumeShelveTestJSON-97641738-project-member] Enqueued Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_members [ 1128.572706] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGHEST for action security_group_members [ 1128.573022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-745fb2b7-cb25-4398-b51d-8a61982bb1ed taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.573135] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.573198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.573391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.573545] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.573664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.573737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.573842] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.573933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.574021] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.671490] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.671649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.671835] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1045eef4-6f3a-4231-9c69-290209beba35 with status ACTIVE [ 1128.672012] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.672124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.672194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.672405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.672493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.672659] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.672750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.672810] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.672972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.673054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.673244] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.673337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.673398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.673528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.673598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.673679] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1045eef4-6f3a-4231-9c69-290209beba35 is going to be updated. [ 1128.695845] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.695981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.696137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.696269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.696408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.696565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1045eef4-6f3a-4231-9c69-290209beba35" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.707828] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: SUCCESS [ 1128.707996] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55872268-81d2-4523-87e7-e00ce5194127 deletion is rescheduled due to dependency. [ 1128.708127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.708291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.708766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.709091] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.709091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.709299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.709299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.709969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.709969] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.920376] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.920568] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.920657] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.920976] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.921343] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.921581] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.921754] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.922404] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.922563] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.922794] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1128.922962] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1128.923154] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1128.923327] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1128.923517] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1128.923660] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1128.923825] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1128.946078] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1128.946313] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1128.946445] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1128.946911] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-353" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.946911] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-334b1fdf-696f-44af-bee4-13c456a36c06 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.947134] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.947270] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.947534] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.947672] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('334b1fdf-696f-44af-bee4-13c456a36c06',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.076438] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.076616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.076698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.077096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.077234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.077446] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.077568] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.077633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.077812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.077894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.077992] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed is going to be updated. [ 1129.106167] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.106344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.106397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.106764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.106950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.116752] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed in Status: IN_PROGRESS for 2s [ 1129.212050] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.450656] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.451011] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.451221] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.451614] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.451834] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.452275] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.452514] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.452694] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.453023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.453241] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.453633] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.453865] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.454057] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.454358] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.454563] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.454773] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 334b1fdf-696f-44af-bee4-13c456a36c06 is going to be updated. [ 1129.604493] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.604814] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.604855] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.605159] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.605380] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.605614] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.715295] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.144871] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1130.145094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.145275] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.145482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.145698] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.145823] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.145911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.146108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.146236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.146398] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.221773] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.221773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.221893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.222133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.222242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.222342] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55872268-81d2-4523-87e7-e00ce5194127 is going to be updated. [ 1130.227834] env[67003]: INFO networking_nsxv3.common.synchronization [req-a915956e-d2fa-483e-a20a-991f384d2d67 req-ac6d4345-c4aa-4c78-bca9-ecbbef6be37a service nova] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_rules [ 1130.228187] env[67003]: INFO networking_nsxv3.common.synchronization [req-a915956e-d2fa-483e-a20a-991f384d2d67 req-ac6d4345-c4aa-4c78-bca9-ecbbef6be37a service nova] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1130.228309] env[67003]: INFO networking_nsxv3.common.synchronization [req-a915956e-d2fa-483e-a20a-991f384d2d67 req-ac6d4345-c4aa-4c78-bca9-ecbbef6be37a service nova] Enqueued Resource ID: 334b1fdf-696f-44af-bee4-13c456a36c06 with Priority: HIGHEST for action port [ 1130.229525] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_rules [ 1130.229725] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1130.229907] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 334b1fdf-696f-44af-bee4-13c456a36c06 with Priority: HIGHEST for action port [ 1130.230316] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.230564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.230700] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.230922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.231155] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.232024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.232181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.232251] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.232473] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.232645] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.232773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.232862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.233075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.233194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.233313] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.234887] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-334b1fdf-696f-44af-bee4-13c456a36c06 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.235122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.235247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.235460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.235567] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('334b1fdf-696f-44af-bee4-13c456a36c06',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.253950] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.254151] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.254248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.254483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.254663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.265344] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: IN_PROGRESS for 2s [ 1130.649104] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.737384] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.738618] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.738751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.739184] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 334b1fdf-696f-44af-bee4-13c456a36c06 with status ACTIVE [ 1130.739735] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.739735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.739735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.739918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.739918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.740024] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.741732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.741732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.741732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.741732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.741732] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.741732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.741732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.741732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.741732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.741732] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 334b1fdf-696f-44af-bee4-13c456a36c06 is going to be updated. [ 1130.771913] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.772096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.772134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.772538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.772538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.772737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-334b1fdf-696f-44af-bee4-13c456a36c06" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.988080] env[67003]: INFO networking_nsxv3.common.synchronization [req-674e30a8-a848-417c-bc79-a59ce790955a req-c1f8968b-9ffe-40fe-b718-1869ca772cf1 tempest-ServerRescueNegativeTestJSON-408866913 tempest-ServerRescueNegativeTestJSON-408866913-project-member] Enqueued Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_members [ 1130.988702] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGHEST for action security_group_members [ 1130.989021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.989426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.989426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.989581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.989613] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.989731] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.989798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.989924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.990019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.990114] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.128209] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed in Status: SUCCESS [ 1131.128461] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed deletion is rescheduled due to dependency. [ 1131.128591] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.151136] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.240400] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.492879] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.493064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.493064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.493229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.493323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.493604] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.493717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.493784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.493943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.494038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.494131] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 is going to be updated. [ 1131.523606] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.523724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.524684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.524684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.524684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.534401] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: IN_PROGRESS for 2s [ 1131.653244] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.653643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.653643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.653713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.653747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.653849] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1131.683952] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.684118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.684178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.684394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.684540] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.692944] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1131.743542] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.743734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.743789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.743998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.744102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.744200] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be updated. [ 1131.815412] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.815556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.815628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.815841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.815985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.825391] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: IN_PROGRESS for 2s [ 1132.275658] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: SUCCESS [ 1132.275981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.276299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.276630] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.276954] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.277239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.277350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.277616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.277763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.277926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.278111] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.781021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.781384] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.781460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.781862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.782224] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.782446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.782591] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.782842] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.783017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.783220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.783545] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.783787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.783905] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.784144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.784531] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.784718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.784938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.785156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.785272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.785395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.785551] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.288288] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 55872268-81d2-4523-87e7-e00ce5194127: rpc.has_security_group_logging(os_id): False [ 1133.306499] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.306685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.306685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.306890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.306988] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.307629] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.307629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.307629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.307629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.307873] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.307873] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.307975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.307975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.308123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.308209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.308387] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.308481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.308542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.308681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.308755] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.308840] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55872268-81d2-4523-87e7-e00ce5194127 is going to be updated. [ 1133.387684] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.387891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.387891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.388130] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.388279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.401510] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: IN_PROGRESS for 2s [ 1133.543832] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 in Status: SUCCESS [ 1133.544025] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 deletion is rescheduled due to dependency. [ 1133.544132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.703879] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1133.704114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.704364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.704484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.704673] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.704792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.704858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.705016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.705122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.705210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.705301] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.835475] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 1133.835786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.835884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.836161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.836407] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.836553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.836648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.836821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.836906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.837025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.837203] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.207894] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.208192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.208192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.208386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.208561] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.208662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.208726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.208874] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.208961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.209068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.209244] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.209348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.209469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.209551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.209688] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.209778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.209839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.209974] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.210065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.210147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.210236] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.339377] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.339614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.339718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.339993] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.340231] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.340369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.340457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.340670] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.340793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.340918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.341129] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.341285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.341344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.341527] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.341713] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.341836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.341932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.342348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.342348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.342348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.342497] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.712895] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f76f58af-f507-4428-b198-11ce6caf814d: rpc.has_security_group_logging(os_id): False [ 1134.732060] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.732263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.732310] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.732512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.733719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.733719] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.733719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.733719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.733719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.733719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.733719] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.733719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.733719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.733719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.733719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.734283] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.734283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.734283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.734283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.734283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.734505] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1134.809207] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.809894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.809894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.809894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.809894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.826286] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1134.845816] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a: rpc.has_security_group_logging(os_id): False [ 1134.886315] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.886477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.886550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.886761] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.886862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.887161] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.887269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.887322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.887481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.887560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.887748] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.887843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.887931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.888092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.888146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.888339] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.888450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.888535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.888772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.888772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.888856] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be updated. [ 1134.974158] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.974341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.974447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.974703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.974908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.026099] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: IN_PROGRESS for 2s [ 1135.416649] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: SUCCESS [ 1135.416915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.680169] env[67003]: INFO networking_nsxv3.common.synchronization [req-b60940d4-4086-478d-9c19-bb9d22930dda req-dce619dc-e765-4b3e-9cde-2475be5c4b5c tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_members [ 1135.680895] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGHEST for action security_group_members [ 1135.681111] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.681239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.681311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.681514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.681661] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.681760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.681814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.681968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.682068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.682169] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.731433] env[67003]: INFO networking_nsxv3.common.synchronization [req-b60940d4-4086-478d-9c19-bb9d22930dda req-dce619dc-e765-4b3e-9cde-2475be5c4b5c tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 2418bedd-9d88-482f-a1f8-8b184be2b6af with Priority: HIGHEST for action port [ 1135.731977] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2418bedd-9d88-482f-a1f8-8b184be2b6af with Priority: HIGHEST for action port [ 1135.732294] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2418bedd-9d88-482f-a1f8-8b184be2b6af taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.732415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2418bedd-9d88-482f-a1f8-8b184be2b6af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.732485] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2418bedd-9d88-482f-a1f8-8b184be2b6af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.732677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2418bedd-9d88-482f-a1f8-8b184be2b6af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.732759] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2418bedd-9d88-482f-a1f8-8b184be2b6af',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.184976] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.185396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.185396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.186023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.186023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.186023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.186203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.186203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.186386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.186386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.186518] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55872268-81d2-4523-87e7-e00ce5194127 is going to be updated. [ 1136.220454] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.220718] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.220801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.221025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.221176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.229911] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: IN_PROGRESS for 2s [ 1136.234695] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2418bedd-9d88-482f-a1f8-8b184be2b6af with status ACTIVE [ 1136.234940] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.235182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.235247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.235486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.235584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.235804] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.235911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.235981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.236182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.236269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.236483] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.236596] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.236660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.236831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.236923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.237033] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2418bedd-9d88-482f-a1f8-8b184be2b6af is going to be updated. [ 1136.264222] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.264426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.264426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.264647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.264778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.264952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2418bedd-9d88-482f-a1f8-8b184be2b6af" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.760034] env[67003]: INFO networking_nsxv3.common.synchronization [None req-56c8583b-a574-4858-a84b-e4b10b9fabe6 tempest-AttachVolumeShelveTestJSON-97641738 tempest-AttachVolumeShelveTestJSON-97641738-project-member] Enqueued Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_rules [ 1136.760034] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_rules [ 1136.760034] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02817089-de2d-4fa5-aa82-3c16b3cb154a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.760034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.760034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.760034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.760034] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.798391] env[67003]: INFO networking_nsxv3.common.synchronization [req-c715cd69-d406-430b-b06d-178bd2c93581 req-e6b6cf12-fb93-4a04-a25d-5055f8aa7ec3 tempest-ServerRescueTestJSON-1581036954 tempest-ServerRescueTestJSON-1581036954-project-member] Enqueued Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_members [ 1136.798897] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_members [ 1136.799221] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.799608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.799608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.799608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.799761] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.799838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.799900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.800462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.800715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.800715] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.846273] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1136.846419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.850462] env[67003]: INFO networking_nsxv3.common.synchronization [None req-25069869-766a-48dd-bb9a-47a8bbad477c tempest-AttachVolumeShelveTestJSON-97641738 tempest-AttachVolumeShelveTestJSON-97641738-project-member] Enqueued Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_rules [ 1136.850462] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_rules [ 1136.850926] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02817089-de2d-4fa5-aa82-3c16b3cb154a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.850926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.045123] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 1137.046265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.197394] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-998 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.197629] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-998" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.197667] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-998" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.197962] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-998" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.198323] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.198500] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.198628] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.198896] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.199070] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.199298] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1137.199419] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1137.199535] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1137.199649] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1137.199759] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1137.199866] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1137.200018] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1137.219646] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1137.219807] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1137.220037] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1137.220256] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-998" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.220586] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-08ce28e6-ce0a-4ce9-976b-9ddecdb03010 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.220763] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-08ce28e6-ce0a-4ce9-976b-9ddecdb03010" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.220883] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-08ce28e6-ce0a-4ce9-976b-9ddecdb03010" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.221242] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-08ce28e6-ce0a-4ce9-976b-9ddecdb03010" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.221385] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08ce28e6-ce0a-4ce9-976b-9ddecdb03010',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.283528] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.283680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.283750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.283960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.284060] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.284155] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a already deleted. [ 1137.284239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.284384] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.284533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.284618] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.303860] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.724679] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.724928] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.725109] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.725410] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.725577] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.725738] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 08ce28e6-ce0a-4ce9-976b-9ddecdb03010 not found, creating... [ 1137.726064] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.726313] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.726455] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.726746] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.726832] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.727196] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.727386] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.727519] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.727733] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.727867] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.728016] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 08ce28e6-ce0a-4ce9-976b-9ddecdb03010 is going to be created. [ 1137.753145] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.753514] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.753725] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.754134] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.754493] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.754840] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-08ce28e6-ce0a-4ce9-976b-9ddecdb03010" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.804989] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.806911] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.807114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.807185] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.807396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.807487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.807584] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a already deleted. [ 1137.807661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.240771] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 55872268-81d2-4523-87e7-e00ce5194127 in Status: SUCCESS [ 1138.241170] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 55872268-81d2-4523-87e7-e00ce5194127 deletion is rescheduled due to dependency. [ 1138.241170] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.308939] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.308939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.309363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.309459] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.309563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.309991] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 is going to be updated. [ 1138.358686] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.358959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.358959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.359140] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.359289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.375644] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: IN_PROGRESS for 2s [ 1138.499062] env[67003]: INFO networking_nsxv3.common.synchronization [req-c715cd69-d406-430b-b06d-178bd2c93581 req-f60dfbb6-662e-49f5-96ab-327b5d3eb0a6 service nova] Enqueued Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_rules [ 1138.499301] env[67003]: INFO networking_nsxv3.common.synchronization [req-c715cd69-d406-430b-b06d-178bd2c93581 req-f60dfbb6-662e-49f5-96ab-327b5d3eb0a6 service nova] Enqueued Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_members [ 1138.499768] env[67003]: INFO networking_nsxv3.common.synchronization [req-c715cd69-d406-430b-b06d-178bd2c93581 req-f60dfbb6-662e-49f5-96ab-327b5d3eb0a6 service nova] Enqueued Resource ID: 08ce28e6-ce0a-4ce9-976b-9ddecdb03010 with Priority: HIGHEST for action port [ 1138.502857] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_rules [ 1138.502857] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_members [ 1138.502857] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 08ce28e6-ce0a-4ce9-976b-9ddecdb03010 with Priority: HIGHEST for action port [ 1138.502857] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.502857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.502857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.502857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.502857] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.503838] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.503878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.504314] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-08ce28e6-ce0a-4ce9-976b-9ddecdb03010 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.504430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-08ce28e6-ce0a-4ce9-976b-9ddecdb03010" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.504561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-08ce28e6-ce0a-4ce9-976b-9ddecdb03010" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.504838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-08ce28e6-ce0a-4ce9-976b-9ddecdb03010" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.505137] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('08ce28e6-ce0a-4ce9-976b-9ddecdb03010',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.009377] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.009377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.009377] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 08ce28e6-ce0a-4ce9-976b-9ddecdb03010 with status ACTIVE [ 1139.009377] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.009377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.009377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.009377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.009377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.009884] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.009884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.009965] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.010214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.010272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.010558] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.010705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.011211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.011211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.011211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.011305] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 08ce28e6-ce0a-4ce9-976b-9ddecdb03010 is going to be updated. [ 1139.035091] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.035269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.035356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.035583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.035730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.035911] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-08ce28e6-ce0a-4ce9-976b-9ddecdb03010" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.428793] env[67003]: INFO networking_nsxv3.common.synchronization [req-b47605ad-5fc0-48ec-a01e-42d4e3cf8f1c req-18c7c572-3559-4d2c-a56d-482293700a81 tempest-ServerActionsTestOtherB-185944640 tempest-ServerActionsTestOtherB-185944640-project-member] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1139.429340] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1139.429640] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.429783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.429827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.430023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.430357] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.430357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.430357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.430488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.430547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.430612] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1139.934343] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.934343] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.934343] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.934928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.958547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.959257] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.959420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.959575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.961288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.961288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.961288] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be updated. [ 1139.994154] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.994345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.994393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.994588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.994730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.004706] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 2s [ 1140.386696] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: SUCCESS [ 1140.386962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.387255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.387505] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.387733] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1140.387871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1140.388107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1140.388246] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1140.388295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.388496] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1140.891921] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.147450] env[67003]: INFO networking_nsxv3.common.synchronization [req-39cf0524-e0be-4df7-8c1d-97bf3ec20e18 req-51324f8d-2e05-4cfb-9159-d3b4252a0a22 tempest-ServerActionsTestJSON-1949922754 tempest-ServerActionsTestJSON-1949922754-project-member] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1141.148176] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1141.148380] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.148510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.148579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.148814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.148977] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.149108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.149173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.149344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.149437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.149534] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.395984] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.504527] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.504726] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.504849] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.505236] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.505527] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.505687] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.505804] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.506216] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.506429] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.506700] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.506875] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1141.507035] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1141.507271] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1141.507441] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1141.507597] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1141.507785] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1141.531881] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1141.532121] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1141.532285] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1141.532555] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.532960] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.533159] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.533259] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.533611] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.533753] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.655672] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.655672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.655672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.655672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.655672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.655672] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.655672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.655672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.655672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.655672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.655672] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 is going to be updated. [ 1141.691211] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.691431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.691431] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.691642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.691791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.702234] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: IN_PROGRESS for 2s [ 1141.901449] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.901821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.901821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.901934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.901990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.902106] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 is going to be updated. [ 1141.932357] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.932492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.932567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.932778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.933015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.942716] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: IN_PROGRESS for 2s [ 1142.013440] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 1142.013440] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e deletion is rescheduled due to dependency. [ 1142.013525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.041010] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.041340] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.041426] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.041698] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.041847] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.042011] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a not found, creating... [ 1142.042274] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.042431] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.042550] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.042768] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.042922] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.043222] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.043382] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.043500] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.043705] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.043838] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.043976] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a is going to be created. [ 1142.064344] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.064666] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.064802] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.065142] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.065408] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.065639] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.767704] env[67003]: INFO networking_nsxv3.common.synchronization [req-39cf0524-e0be-4df7-8c1d-97bf3ec20e18 req-314e713d-50c5-4896-9c49-b658d68410dc service nova] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_rules [ 1142.767704] env[67003]: INFO networking_nsxv3.common.synchronization [req-39cf0524-e0be-4df7-8c1d-97bf3ec20e18 req-314e713d-50c5-4896-9c49-b658d68410dc service nova] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1142.767704] env[67003]: INFO networking_nsxv3.common.synchronization [req-39cf0524-e0be-4df7-8c1d-97bf3ec20e18 req-314e713d-50c5-4896-9c49-b658d68410dc service nova] Enqueued Resource ID: 2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a with Priority: HIGHEST for action port [ 1142.768152] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_rules [ 1142.768794] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1142.768794] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a with Priority: HIGHEST for action port [ 1142.768905] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.769018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.769121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.769427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.769427] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1142.770951] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.771079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.771299] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.771399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.771473] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.771705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.771785] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.198810] env[67003]: INFO networking_nsxv3.common.synchronization [req-b6aead24-557f-4226-b4a0-cf9bc15ab38f req-ccbaca14-df91-4a3f-b676-6932ed05af45 tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1143.199398] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1143.199747] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.199874] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.199944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.200159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.200371] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.200607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.200677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.200843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.200987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.201096] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.273917] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.274173] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.274300] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a with status ACTIVE [ 1143.274492] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.274655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.274717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.274876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.274973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.275192] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.275296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.275344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.275509] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.275589] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.275762] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.275854] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.275915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.276074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.276143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.276223] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a is going to be updated. [ 1143.297753] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.297902] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.298191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.298191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.298361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.298488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cdf0f6e-68d1-4f2d-87a3-eb3ddc27925a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.704687] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.714765] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: SUCCESS [ 1143.714765] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 deletion is rescheduled due to dependency. [ 1143.714765] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.714765] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.714963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.715064] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.715190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.715255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.715422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.715499] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.715600] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.953294] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: SUCCESS [ 1143.953514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.953685] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.953908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.954128] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.954244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.954312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.954470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.954547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.954630] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.954719] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.210471] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.218045] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.456871] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.457071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.457850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.457850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.457850] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.458019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.458019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.458242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.458372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.458493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.458671] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.458769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.458832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.458977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.459132] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.459219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.459282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.459415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.459512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.459590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.459694] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.715071] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.715249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.715320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.715538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.715629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.715730] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1144.723417] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.744245] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.744358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.744402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.744610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.744753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.753996] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1144.961651] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62aff8a2-792c-4df1-90fb-88b44b18cc02: rpc.has_security_group_logging(os_id): False [ 1144.981537] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.981716] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.981789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.982068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.982171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.982342] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.982442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.982508] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.982655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.982734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.982932] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.983039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.983100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.983243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.983316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.983604] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.983710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.983782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.983933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.984019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.984109] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 is going to be updated. [ 1145.083241] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.083460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.083549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.083813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.083998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.114702] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: IN_PROGRESS for 2s [ 1145.226810] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.227235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.227235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.227408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.227501] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.227616] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 is going to be updated. [ 1145.268859] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.269091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.269167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.269427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.269577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.281732] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: IN_PROGRESS for 2s [ 1145.695498] env[67003]: INFO networking_nsxv3.common.synchronization [req-d9d8d550-e408-4da4-8a79-9f6e1064c8c2 req-ea563644-f6e0-46d6-91fa-a403cf9c58fc tempest-AttachVolumeShelveTestJSON-97641738 tempest-AttachVolumeShelveTestJSON-97641738-project-member] Enqueued Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_members [ 1145.696078] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_members [ 1145.696403] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-02817089-de2d-4fa5-aa82-3c16b3cb154a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.696559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.696656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.696837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.697017] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.697235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.697330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.697453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.697536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.697628] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.056945] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.057208] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.057369] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.057680] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.057994] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.058196] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.058320] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.058547] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.058679] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.058879] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.058983] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1146.059100] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1146.059202] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1146.059304] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1146.059403] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1146.059528] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1146.080066] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1146.080154] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1146.080285] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1146.080529] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.080849] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-d514752b-8eef-4d09-918b-0652fbf1874b taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.081044] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.081165] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.081485] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.081626] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d514752b-8eef-4d09-918b-0652fbf1874b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.200374] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.200588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.200588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.200824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.200902] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.201114] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.201233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.201359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.201466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.201537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.201585] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a already deleted. [ 1146.201663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.585248] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.588421] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.588636] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.589079] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.589344] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.590218] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port d514752b-8eef-4d09-918b-0652fbf1874b not found, creating... [ 1146.590218] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.590482] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.590833] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.591137] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.591346] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.595022] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.595022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.595022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.595022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.595022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.595022] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: d514752b-8eef-4d09-918b-0652fbf1874b is going to be created. [ 1146.616189] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.616694] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.616755] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.617019] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.619666] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.619666] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.765085] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1146.765273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.947391] env[67003]: INFO networking_nsxv3.common.synchronization [req-7a0b41a2-afb9-4267-a3ea-ca51502a241f req-a20d449d-e9c8-459b-b3c5-7f385382eea9 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_members [ 1146.947391] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_members [ 1146.947608] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.947893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.948073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.948377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.948629] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.948838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.948977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.949306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.949528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.949736] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.277913] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: SUCCESS [ 1147.278163] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.297589] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: SUCCESS [ 1147.297818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.298011] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.298256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.298446] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.298564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.298630] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.298776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.298859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.298939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.299036] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.311939] env[67003]: INFO networking_nsxv3.common.synchronization [req-31ad998b-d72f-47b8-8414-5bd9ec443740 req-a65712be-84cb-4bdb-b9a2-40ff8efb8b37 tempest-DeleteServersTestJSON-1342989894 tempest-DeleteServersTestJSON-1342989894-project-member] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1147.312152] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGHEST for action security_group_members [ 1147.312425] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.312570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.312668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.313521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.313521] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.313521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.313521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.313767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.313809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.313881] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.365340] env[67003]: INFO networking_nsxv3.common.synchronization [req-d9d8d550-e408-4da4-8a79-9f6e1064c8c2 req-5bb846f3-1903-466f-a6c3-9d5f32588791 service nova] Enqueued Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_rules [ 1147.365340] env[67003]: INFO networking_nsxv3.common.synchronization [req-d9d8d550-e408-4da4-8a79-9f6e1064c8c2 req-5bb846f3-1903-466f-a6c3-9d5f32588791 service nova] Enqueued Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_members [ 1147.365340] env[67003]: INFO networking_nsxv3.common.synchronization [req-d9d8d550-e408-4da4-8a79-9f6e1064c8c2 req-5bb846f3-1903-466f-a6c3-9d5f32588791 service nova] Enqueued Resource ID: d514752b-8eef-4d09-918b-0652fbf1874b with Priority: HIGHEST for action port [ 1147.365340] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_rules [ 1147.365340] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_members [ 1147.365340] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d514752b-8eef-4d09-918b-0652fbf1874b with Priority: HIGHEST for action port [ 1147.367818] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02817089-de2d-4fa5-aa82-3c16b3cb154a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.367955] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.368034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.368267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.368351] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.370016] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-02817089-de2d-4fa5-aa82-3c16b3cb154a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.370016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.370016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.370016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.370016] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.370016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.370016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.370366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.370366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.370366] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.371643] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d514752b-8eef-4d09-918b-0652fbf1874b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.371643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.371643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.371643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.371643] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d514752b-8eef-4d09-918b-0652fbf1874b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.454248] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.801809] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.819482] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.819639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.819700] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.819907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.820758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.821037] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.821769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.821769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.821769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.821769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.821769] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be updated. [ 1147.850166] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.850374] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.850426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.850667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.851062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.861147] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: IN_PROGRESS for 2s [ 1147.873796] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-02817089-de2d-4fa5-aa82-3c16b3cb154a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.873997] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.874180] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.875279] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d514752b-8eef-4d09-918b-0652fbf1874b with status ACTIVE [ 1147.875502] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.875654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.875731] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.875979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.876084] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.876317] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.876425] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.876490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.876670] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.876769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.876963] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.877112] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.877269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.877441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.877531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.877608] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d514752b-8eef-4d09-918b-0652fbf1874b is going to be updated. [ 1147.904939] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.905238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.905238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.905496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.905679] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.905865] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.956842] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.306129] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7f76d7e-ac8b-403e-8138-5cfc21622e31: rpc.has_security_group_logging(os_id): False [ 1148.326660] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.326854] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.327270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.327541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.327643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.327916] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.328079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.328193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.328286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.328375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.328469] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 is going to be updated. [ 1148.379677] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.412036] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.412036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.412036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.412036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.412036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.426634] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: IN_PROGRESS for 2s [ 1148.459518] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.459668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.459793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.459954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.460063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.460156] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 is going to be updated. [ 1148.499035] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.499244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.499314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.499564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.499710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.517702] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: IN_PROGRESS for 2s [ 1148.881981] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.882272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.882272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.882420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.882507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.882610] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a is going to be created. [ 1148.910911] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.911067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.911133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.911344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.911506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.923766] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a in Status: UNINITIALIZED for 2s [ 1149.873823] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 in Status: SUCCESS [ 1149.874148] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 deletion is rescheduled due to dependency. [ 1149.874273] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.039038] env[67003]: INFO networking_nsxv3.common.synchronization [req-e7d54c89-af8c-4bf2-a5f0-ccdb7c12b782 req-6663d5a7-6942-4481-830f-1260f12b2f48 tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1150.039640] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1150.039901] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.040035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.040105] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.040301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.040450] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.040701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.040701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.040789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.040817] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.041463] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.440147] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: SUCCESS [ 1150.440412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.526879] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: SUCCESS [ 1150.527111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.543062] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.934915] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a in Status: SUCCESS [ 1150.934915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.934915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.935157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.935269] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.935386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.935447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.935603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.935678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.935759] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.936612] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.046049] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.438079] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.547564] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.547767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.547767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.547986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.548085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.548204] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1151.580294] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.580516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.580516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.580739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.580893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.592633] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1151.787958] env[67003]: INFO networking_nsxv3.common.synchronization [req-5aba7672-4ba0-4347-83e2-8fc43351c534 req-749b8413-fc31-44a4-a25c-0183a4defd61 tempest-ServerActionsTestOtherB-185944640 tempest-ServerActionsTestOtherB-185944640-project-member] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1151.788170] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1151.788915] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.789100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.789179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.789412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.789574] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.789677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.789741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.789933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.790041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.790140] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.941911] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02817089-de2d-4fa5-aa82-3c16b3cb154a: rpc.has_security_group_logging(os_id): False [ 1151.961326] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.961456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.961518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.961726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.961805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.962124] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.962228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.962289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.962448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.962544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.962631] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a is going to be created. [ 1152.023626] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.023769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.023840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.024098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.024352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.036568] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a in Status: IN_PROGRESS for 2s [ 1152.104062] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.104374] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.104903] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.105292] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.105610] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.105784] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.105912] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.106173] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.106358] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.106581] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.106693] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1152.106801] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1152.106904] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1152.107019] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1152.107128] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1152.107296] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1152.145128] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1152.145318] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1152.145441] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1152.145626] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.145996] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-03fda817-47f7-4a3d-b3c1-2d93ca50df68 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.146186] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-03fda817-47f7-4a3d-b3c1-2d93ca50df68" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.146307] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-03fda817-47f7-4a3d-b3c1-2d93ca50df68" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.146639] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-03fda817-47f7-4a3d-b3c1-2d93ca50df68" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.146777] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03fda817-47f7-4a3d-b3c1-2d93ca50df68',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1152.292407] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.293457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.293457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.293457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.293457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.293662] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.293662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.293745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.293860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.293967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.294086] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be updated. [ 1152.321247] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.321491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.321627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.321920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.322120] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.331157] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 2s [ 1152.649627] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.649876] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.650009] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.650436] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.650527] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.650691] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 03fda817-47f7-4a3d-b3c1-2d93ca50df68 not found, creating... [ 1152.650961] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.651130] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.651247] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.651471] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.651852] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.651895] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.652045] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.652150] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.652360] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.652495] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.652632] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 03fda817-47f7-4a3d-b3c1-2d93ca50df68 is going to be created. [ 1152.674021] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1152.674504] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1152.674504] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1152.675580] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1152.675580] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1152.675580] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-03fda817-47f7-4a3d-b3c1-2d93ca50df68" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.426257] env[67003]: INFO networking_nsxv3.common.synchronization [req-5aba7672-4ba0-4347-83e2-8fc43351c534 req-7f8168ab-8bad-4fc9-be0b-32512f7e68ad service nova] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_rules [ 1153.426506] env[67003]: INFO networking_nsxv3.common.synchronization [req-5aba7672-4ba0-4347-83e2-8fc43351c534 req-7f8168ab-8bad-4fc9-be0b-32512f7e68ad service nova] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1153.426557] env[67003]: INFO networking_nsxv3.common.synchronization [req-5aba7672-4ba0-4347-83e2-8fc43351c534 req-7f8168ab-8bad-4fc9-be0b-32512f7e68ad service nova] Enqueued Resource ID: 03fda817-47f7-4a3d-b3c1-2d93ca50df68 with Priority: HIGHEST for action port [ 1153.427601] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_rules [ 1153.427715] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1153.427816] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03fda817-47f7-4a3d-b3c1-2d93ca50df68 with Priority: HIGHEST for action port [ 1153.428579] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.428729] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.428799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.429026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.429131] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.431221] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.431349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.432249] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-03fda817-47f7-4a3d-b3c1-2d93ca50df68 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.432249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03fda817-47f7-4a3d-b3c1-2d93ca50df68" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.432249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03fda817-47f7-4a3d-b3c1-2d93ca50df68" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.432249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03fda817-47f7-4a3d-b3c1-2d93ca50df68" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.432249] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03fda817-47f7-4a3d-b3c1-2d93ca50df68',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1153.604739] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1153.604959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.932537] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.932838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.934237] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03fda817-47f7-4a3d-b3c1-2d93ca50df68 with status ACTIVE [ 1153.934556] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.934759] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.934882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.935260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.935402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.935687] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.935868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.936013] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.936287] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.936443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.936752] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.936922] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.937056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.937348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.937465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.937690] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03fda817-47f7-4a3d-b3c1-2d93ca50df68 is going to be updated. [ 1153.960668] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1153.960960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1153.961092] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1153.961320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1153.961478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.961644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03fda817-47f7-4a3d-b3c1-2d93ca50df68" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.048512] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a in Status: SUCCESS [ 1154.048735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.343097] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 1154.343097] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e deletion is rescheduled due to dependency. [ 1154.343373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.343419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.343741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.343966] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.344119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.344306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.344570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.344683] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.344750] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.847823] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.352738] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.552026] env[67003]: INFO networking_nsxv3.common.synchronization [req-bf710c23-7699-4a6c-93de-5aa1c2fb9d93 req-43a4c8d6-ab76-4f81-b566-12286c7a92f2 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_members [ 1155.552508] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGHEST for action security_group_members [ 1155.552751] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.553036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.553036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.553239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.553319] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.553604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.553604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.553604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.553756] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.553756] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1155.855998] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.856446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.856446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.856446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.856567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.856618] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be updated. [ 1155.885814] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.885970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.886063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.886323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.886506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.896146] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 2s [ 1156.055443] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.055630] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.055688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.056626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.056626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.056626] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.056626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.056626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.056626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.056626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.056965] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 is going to be updated. [ 1156.089871] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.089871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.090110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.090505] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.090574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.099966] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: IN_PROGRESS for 2s [ 1157.910079] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 1157.910411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.910445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.910666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.910857] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.910978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.911076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.911295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.911384] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.911474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.911566] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.110931] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 in Status: SUCCESS [ 1158.111129] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 deletion is rescheduled due to dependency. [ 1158.111245] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.414978] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.918376] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 716cf816-3048-4122-8676-0137157fed0e: rpc.has_security_group_logging(os_id): False [ 1158.939182] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.939457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.939560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.939788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.939900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.940190] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.940354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.940402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.940538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.940602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.940712] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be updated. [ 1159.007284] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.007483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.007528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.007774] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.007930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.022703] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 2s [ 1160.553201] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1160.553472] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1161.039905] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 1161.040133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.153949] env[67003]: INFO networking_nsxv3.common.synchronization [None req-9914d821-e162-40a9-86de-2265a10d7407 tempest-AttachInterfacesTestJSON-1544198530 tempest-AttachInterfacesTestJSON-1544198530-project-member] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1161.154483] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGHEST for action security_group_members [ 1161.155858] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.155858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.155858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.155858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.155858] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.155858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.155858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.155858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.155858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.156441] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.658421] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.659209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.659298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.659670] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.659736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.660090] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.660301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.660518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.660743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.660829] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.660943] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be updated. [ 1161.691430] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.691594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.691649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.691827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.691969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.701601] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: IN_PROGRESS for 2s [ 1162.312569] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ada14c07-1eac-4e0f-8642-c2f6f4be05d8 None None] Enqueued Resource ID: 912e4bcb-d0bb-4fbf-b931-304976f6e80f with Priority: HIGHEST for action port [ 1162.313177] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 912e4bcb-d0bb-4fbf-b931-304976f6e80f with Priority: HIGHEST for action port [ 1162.313521] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-912e4bcb-d0bb-4fbf-b931-304976f6e80f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.313654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-912e4bcb-d0bb-4fbf-b931-304976f6e80f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.313737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-912e4bcb-d0bb-4fbf-b931-304976f6e80f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.314119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-912e4bcb-d0bb-4fbf-b931-304976f6e80f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.314224] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('912e4bcb-d0bb-4fbf-b931-304976f6e80f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.817490] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 912e4bcb-d0bb-4fbf-b931-304976f6e80f [ 1162.817490] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.817490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.817490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.817490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.817490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.817490] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:912e4bcb-d0bb-4fbf-b931-304976f6e80f already deleted. [ 1162.817490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-912e4bcb-d0bb-4fbf-b931-304976f6e80f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.078432] env[67003]: INFO networking_nsxv3.common.synchronization [req-0c2907d8-54de-421b-9e2a-8e279e7c9eb9 req-6fbde3ab-470e-4ca2-bc2d-da46e6f565c8 tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_members [ 1163.078692] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_members [ 1163.080089] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.080279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.080372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.080663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.080910] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.081033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.081095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.081255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.081393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.081445] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.585618] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.658142] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-744 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.659342] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.659342] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.659342] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.659342] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.659342] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.659621] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.659708] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.659877] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.660147] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.660291] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.660425] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.660559] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.660693] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.660821] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.660988] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.684762] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.684762] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1163.684762] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.684762] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-744" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.684762] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-d38687f9-79f0-4a46-bc4e-4504328f2e93 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.684762] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-d38687f9-79f0-4a46-bc4e-4504328f2e93" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.684762] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-d38687f9-79f0-4a46-bc4e-4504328f2e93" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.684762] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-d38687f9-79f0-4a46-bc4e-4504328f2e93" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.684762] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d38687f9-79f0-4a46-bc4e-4504328f2e93',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.713059] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a in Status: SUCCESS [ 1163.713666] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a deletion is rescheduled due to dependency. [ 1163.713666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.941656] env[67003]: INFO networking_nsxv3.common.synchronization [req-ded674ed-cf41-4de5-8e05-6b47a190cd86 req-37fcef92-f7ad-4d58-96c8-08127af66fd7 tempest-ServerRescueTestJSON-1581036954 tempest-ServerRescueTestJSON-1581036954-project-member] Enqueued Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_members [ 1163.942452] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_members [ 1163.943399] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.943399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.943399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.943656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.943708] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.944061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.944061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.944230] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.944361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.944535] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.088203] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.188874] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.189206] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.189386] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.189737] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.189972] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.191163] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port d38687f9-79f0-4a46-bc4e-4504328f2e93 not found, creating... [ 1164.191163] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.191163] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.191163] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.191163] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.191426] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.191602] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.191807] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.191918] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.192178] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.192370] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.192493] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: d38687f9-79f0-4a46-bc4e-4504328f2e93 is going to be created. [ 1164.214383] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.216219] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.216219] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.216219] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.216219] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.216219] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-d38687f9-79f0-4a46-bc4e-4504328f2e93" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.447440] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.590661] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.590795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.590864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.591146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.591238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.591340] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc is going to be updated. [ 1164.623839] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.624220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.624220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.624864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.624864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.634021] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: IN_PROGRESS for 2s [ 1164.772501] env[67003]: INFO networking_nsxv3.common.synchronization [None req-b170cb2f-6199-4fd6-85b5-f50b2db7c7aa None None] Enqueued Resource ID: 40a2f386-9859-44ba-9638-61f5bee3da9f with Priority: HIGHEST for action port [ 1164.773078] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40a2f386-9859-44ba-9638-61f5bee3da9f with Priority: HIGHEST for action port [ 1164.773388] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-40a2f386-9859-44ba-9638-61f5bee3da9f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.773516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40a2f386-9859-44ba-9638-61f5bee3da9f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.773586] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40a2f386-9859-44ba-9638-61f5bee3da9f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.773851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40a2f386-9859-44ba-9638-61f5bee3da9f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.773936] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40a2f386-9859-44ba-9638-61f5bee3da9f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.934375] env[67003]: INFO networking_nsxv3.common.synchronization [req-0c2907d8-54de-421b-9e2a-8e279e7c9eb9 req-959645a9-dce8-46fd-a2c9-9582d201642e service nova] Enqueued Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_rules [ 1164.934572] env[67003]: INFO networking_nsxv3.common.synchronization [req-0c2907d8-54de-421b-9e2a-8e279e7c9eb9 req-959645a9-dce8-46fd-a2c9-9582d201642e service nova] Enqueued Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_members [ 1164.934711] env[67003]: INFO networking_nsxv3.common.synchronization [req-0c2907d8-54de-421b-9e2a-8e279e7c9eb9 req-959645a9-dce8-46fd-a2c9-9582d201642e service nova] Enqueued Resource ID: d38687f9-79f0-4a46-bc4e-4504328f2e93 with Priority: HIGHEST for action port [ 1164.935306] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_rules [ 1164.935447] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_members [ 1164.935547] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d38687f9-79f0-4a46-bc4e-4504328f2e93 with Priority: HIGHEST for action port [ 1164.935831] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.935950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.936037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.936303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.936303] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.937354] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.937354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.937545] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d38687f9-79f0-4a46-bc4e-4504328f2e93 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.937633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d38687f9-79f0-4a46-bc4e-4504328f2e93" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.937687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d38687f9-79f0-4a46-bc4e-4504328f2e93" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.937970] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d38687f9-79f0-4a46-bc4e-4504328f2e93" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.937970] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d38687f9-79f0-4a46-bc4e-4504328f2e93',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.953178] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.269119] env[67003]: INFO networking_nsxv3.common.synchronization [req-d30d433d-1686-4a89-9983-d246f75e2d1c req-bfae502f-f808-46c3-834e-ef5dd249cee2 tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1165.269694] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1165.270021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.270141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.270211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.270403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.270553] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.270646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.270706] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.270844] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.270928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.271031] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.277841] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 40a2f386-9859-44ba-9638-61f5bee3da9f [ 1165.278034] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.278152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.278216] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.278396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.278481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.278576] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:40a2f386-9859-44ba-9638-61f5bee3da9f already deleted. [ 1165.278657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40a2f386-9859-44ba-9638-61f5bee3da9f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.439551] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.439732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.439923] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d38687f9-79f0-4a46-bc4e-4504328f2e93 with status ACTIVE [ 1165.440115] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.440225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.440291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.440503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.440593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.440793] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.440889] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.440987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.441112] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.441188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.441380] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.441474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.441530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.441663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.441771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.441816] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d38687f9-79f0-4a46-bc4e-4504328f2e93 is going to be updated. [ 1165.458782] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.458782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.458782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.459744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.459744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.459744] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 is going to be updated. [ 1165.464297] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.464297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.464496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.464527] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.464673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.464834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d38687f9-79f0-4a46-bc4e-4504328f2e93" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.489829] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.489984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.490040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.490289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.490447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.501508] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: IN_PROGRESS for 2s [ 1165.590040] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.590342] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.590561] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.590977] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.591408] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.591671] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.592217] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.592217] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.592461] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.592783] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.592979] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.593191] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.593382] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.593583] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.593775] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.593983] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.618095] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.618095] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1165.618095] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.618095] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.618095] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-d8508767-67d8-4e31-8662-9f12755d395d taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.618552] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-d8508767-67d8-4e31-8662-9f12755d395d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.618552] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-d8508767-67d8-4e31-8662-9f12755d395d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.618814] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-d8508767-67d8-4e31-8662-9f12755d395d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.618814] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8508767-67d8-4e31-8662-9f12755d395d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.773358] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.121733] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.122071] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.122071] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.122358] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.122511] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.122664] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port d8508767-67d8-4e31-8662-9f12755d395d not found, creating... [ 1166.123795] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.123795] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.123795] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.123795] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.123795] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.124102] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.124299] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.124478] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.124828] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.125814] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.126021] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: d8508767-67d8-4e31-8662-9f12755d395d is going to be created. [ 1166.149368] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.149368] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.149368] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.149531] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.149653] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.149875] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-d8508767-67d8-4e31-8662-9f12755d395d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.276310] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.470310] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ebf17ce2-a13e-4649-866e-a4625fdf437a None None] Enqueued Resource ID: 7fcf0bac-2fe2-4b1e-9347-5681d9bb72b2 with Priority: HIGHEST for action port [ 1166.470504] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fcf0bac-2fe2-4b1e-9347-5681d9bb72b2 with Priority: HIGHEST for action port [ 1166.471090] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fcf0bac-2fe2-4b1e-9347-5681d9bb72b2 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.471228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fcf0bac-2fe2-4b1e-9347-5681d9bb72b2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.471319] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fcf0bac-2fe2-4b1e-9347-5681d9bb72b2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.471514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fcf0bac-2fe2-4b1e-9347-5681d9bb72b2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.471724] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fcf0bac-2fe2-4b1e-9347-5681d9bb72b2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.643655] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: SUCCESS [ 1166.643875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.644106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.644301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.644487] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.644624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.644697] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.645039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.645039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.645132] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.778705] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.778857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.778932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.779164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.779255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.779354] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1166.811741] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.811890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.811963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.812187] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.812336] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.823027] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1166.844335] env[67003]: INFO networking_nsxv3.common.synchronization [req-d30d433d-1686-4a89-9983-d246f75e2d1c req-3715ae60-e49a-4dab-be89-53cc6f775f9e service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1166.844516] env[67003]: INFO networking_nsxv3.common.synchronization [req-d30d433d-1686-4a89-9983-d246f75e2d1c req-3715ae60-e49a-4dab-be89-53cc6f775f9e service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1166.844635] env[67003]: INFO networking_nsxv3.common.synchronization [req-d30d433d-1686-4a89-9983-d246f75e2d1c req-3715ae60-e49a-4dab-be89-53cc6f775f9e service nova] Enqueued Resource ID: d8508767-67d8-4e31-8662-9f12755d395d with Priority: HIGHEST for action port [ 1166.844969] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1166.844969] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1166.845088] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8508767-67d8-4e31-8662-9f12755d395d with Priority: HIGHEST for action port [ 1166.845684] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.845805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.845870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.849217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.849335] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.851397] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.851397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.851397] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8508767-67d8-4e31-8662-9f12755d395d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.851397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8508767-67d8-4e31-8662-9f12755d395d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.851397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8508767-67d8-4e31-8662-9f12755d395d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.851660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8508767-67d8-4e31-8662-9f12755d395d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.851660] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8508767-67d8-4e31-8662-9f12755d395d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.974331] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fcf0bac-2fe2-4b1e-9347-5681d9bb72b2 [ 1166.974665] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.974808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.974876] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.975103] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.975226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.975348] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fcf0bac-2fe2-4b1e-9347-5681d9bb72b2 already deleted. [ 1166.975465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fcf0bac-2fe2-4b1e-9347-5681d9bb72b2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.125311] env[67003]: INFO networking_nsxv3.common.synchronization [None req-84f22efc-6091-46bf-9e54-71fee45ecda6 tempest-AttachVolumeTestJSON-424960992 tempest-AttachVolumeTestJSON-424960992-project-member] Enqueued Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGHEST for action security_group_rules [ 1167.125876] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGHEST for action security_group_rules [ 1167.126136] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a73c2b37-9987-4ee9-8def-05a85741b451 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.126257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.126322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.126595] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.126681] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.148055] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.231815] env[67003]: INFO networking_nsxv3.common.synchronization [None req-7c45d902-7e8a-4e05-a9c7-a19ac651b66c tempest-AttachVolumeTestJSON-424960992 tempest-AttachVolumeTestJSON-424960992-project-member] Enqueued Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGHEST for action security_group_rules [ 1167.232655] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGHEST for action security_group_rules [ 1167.232989] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a73c2b37-9987-4ee9-8def-05a85741b451 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.233103] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.354081] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.354081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.358067] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8508767-67d8-4e31-8662-9f12755d395d with status ACTIVE [ 1167.358067] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.358067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.358067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.358067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.358067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.358067] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.358067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.358067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.358067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.358067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.358067] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.358067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.358067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.358705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.358705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.358705] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8508767-67d8-4e31-8662-9f12755d395d is going to be updated. [ 1167.383855] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.383855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.383855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.384159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.384265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.384492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8508767-67d8-4e31-8662-9f12755d395d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.517881] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: SUCCESS [ 1167.518130] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.647340] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.647517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.647517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.647796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.647888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.647986] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a73c2b37-9987-4ee9-8def-05a85741b451 already deleted. [ 1167.648096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.648254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.648416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.648490] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.649438] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.152490] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.152800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.152800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.152955] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.153077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.153182] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc is going to be updated. [ 1168.172675] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.172831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.172903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.173129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.173220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.173316] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a73c2b37-9987-4ee9-8def-05a85741b451 already deleted. [ 1168.173397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.184918] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.185098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.185182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.185385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.185532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.195373] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: IN_PROGRESS for 2s [ 1168.662433] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ab316838-12ae-4325-8672-c13160b253b6 None None] Enqueued Resource ID: 2cad9bdc-8ea1-45c7-bf8b-903cd5e56e3f with Priority: HIGHEST for action port [ 1168.663506] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2cad9bdc-8ea1-45c7-bf8b-903cd5e56e3f with Priority: HIGHEST for action port [ 1168.663506] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-2cad9bdc-8ea1-45c7-bf8b-903cd5e56e3f taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.663506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2cad9bdc-8ea1-45c7-bf8b-903cd5e56e3f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.663754] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2cad9bdc-8ea1-45c7-bf8b-903cd5e56e3f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.664083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2cad9bdc-8ea1-45c7-bf8b-903cd5e56e3f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.664083] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2cad9bdc-8ea1-45c7-bf8b-903cd5e56e3f',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.838135] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1168.838488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.839186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.839578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.840056] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.840424] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.840545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.840752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.840889] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.840996] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.169497] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2cad9bdc-8ea1-45c7-bf8b-903cd5e56e3f [ 1169.169831] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.169890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.170042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.170722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.170722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.170722] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2cad9bdc-8ea1-45c7-bf8b-903cd5e56e3f already deleted. [ 1169.170722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2cad9bdc-8ea1-45c7-bf8b-903cd5e56e3f" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.343459] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.846384] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.209676] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: SUCCESS [ 1170.210031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.210148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.210573] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.210809] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.211171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.211267] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.211491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.211577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.211672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.211765] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.337223] env[67003]: INFO networking_nsxv3.common.synchronization [req-55d2f8ce-2a7e-4f33-bfda-7e86cce3d0fd req-aa897b3c-1ebc-4cdc-aa0c-b360349d4343 tempest-InstanceActionsTestJSON-214993564 tempest-InstanceActionsTestJSON-214993564-project-member] Enqueued Resource ID: 21049d56-f228-42f2-ae78-92a23f8b3932 with Priority: HIGHEST for action security_group_members [ 1170.337850] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21049d56-f228-42f2-ae78-92a23f8b3932 with Priority: HIGHEST for action security_group_members [ 1170.338204] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-21049d56-f228-42f2-ae78-92a23f8b3932 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.338403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.338470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.338684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.338846] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.338943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.339019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.339178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.339308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.339416] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21049d56-f228-42f2-ae78-92a23f8b3932',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.348817] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.349023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.349023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.349230] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.349317] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.349418] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1170.385698] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.385919] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.386044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.386298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.386574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.400362] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1170.693996] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-407 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.694371] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-407" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.694619] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-407" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.695393] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-407" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.695516] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.695790] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.695998] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.696361] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.696657] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.696989] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.697215] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.697478] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.697679] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.697886] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.698103] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.698341] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.714560] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.721949] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.722170] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1170.722313] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.722527] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-407" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.722936] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-5c06ac76-b0f6-4907-b175-de58b2b40b26 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.723186] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-5c06ac76-b0f6-4907-b175-de58b2b40b26" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.723388] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-5c06ac76-b0f6-4907-b175-de58b2b40b26" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.723815] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-5c06ac76-b0f6-4907-b175-de58b2b40b26" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.724127] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c06ac76-b0f6-4907-b175-de58b2b40b26',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.842419] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.842598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.842661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.842890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.842990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.843215] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.843319] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.843451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.843542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.843619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.843763] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21049d56-f228-42f2-ae78-92a23f8b3932 already deleted. [ 1170.844137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.216326] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ec9467a-c24b-4be1-ba5a-173726e27cfc: rpc.has_security_group_logging(os_id): False [ 1171.227017] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.228089] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.228089] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.228089] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.228089] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.228089] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 5c06ac76-b0f6-4907-b175-de58b2b40b26 not found, creating... [ 1171.228553] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.228553] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.228684] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.228900] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.229021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.229335] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.229521] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.229708] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.229924] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.230091] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.230237] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 5c06ac76-b0f6-4907-b175-de58b2b40b26 is going to be created. [ 1171.247754] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.247837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.247888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.248311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.257614] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.257739] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.257851] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.258496] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.258496] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.258647] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-5c06ac76-b0f6-4907-b175-de58b2b40b26" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.261056] env[67003]: INFO networking_nsxv3.common.synchronization [req-42df6d04-8bc0-4b67-bf24-f7214ffa2549 req-7e0785ae-6c9b-4465-b40d-6e018e13aa92 tempest-ServerRescueTestJSON-1581036954 tempest-ServerRescueTestJSON-1581036954-project-member] Enqueued Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_members [ 1171.261630] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGHEST for action security_group_members [ 1171.262306] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.262438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.262503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.262781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.263016] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.263131] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.263205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.263367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.263454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.263587] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.279208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.279520] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.280016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.280016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.280016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.280217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.280217] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc is going to be updated. [ 1171.382867] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.383136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.383482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.383609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.383787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.398950] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: IN_PROGRESS for 2s [ 1171.766524] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.766785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.766785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.767051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.767153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.767488] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.767610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.767662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.767843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.767925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.768034] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 is going to be updated. [ 1171.839250] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.839574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.839574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.839860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.840075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.851331] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: IN_PROGRESS for 2s [ 1172.025472] env[67003]: INFO networking_nsxv3.common.synchronization [req-55d2f8ce-2a7e-4f33-bfda-7e86cce3d0fd req-a3bb1efe-7c5f-4644-a7f6-6529128ff856 service nova] Enqueued Resource ID: 21049d56-f228-42f2-ae78-92a23f8b3932 with Priority: HIGHEST for action security_group_rules [ 1172.025472] env[67003]: INFO networking_nsxv3.common.synchronization [req-55d2f8ce-2a7e-4f33-bfda-7e86cce3d0fd req-a3bb1efe-7c5f-4644-a7f6-6529128ff856 service nova] Enqueued Resource ID: 21049d56-f228-42f2-ae78-92a23f8b3932 with Priority: HIGHEST for action security_group_members [ 1172.025472] env[67003]: INFO networking_nsxv3.common.synchronization [req-55d2f8ce-2a7e-4f33-bfda-7e86cce3d0fd req-a3bb1efe-7c5f-4644-a7f6-6529128ff856 service nova] Enqueued Resource ID: 5c06ac76-b0f6-4907-b175-de58b2b40b26 with Priority: HIGHEST for action port [ 1172.025472] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21049d56-f228-42f2-ae78-92a23f8b3932 with Priority: HIGHEST for action security_group_rules [ 1172.025472] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21049d56-f228-42f2-ae78-92a23f8b3932 with Priority: HIGHEST for action security_group_members [ 1172.025472] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5c06ac76-b0f6-4907-b175-de58b2b40b26 with Priority: HIGHEST for action port [ 1172.025472] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21049d56-f228-42f2-ae78-92a23f8b3932 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.025472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.025472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.025472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.025472] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21049d56-f228-42f2-ae78-92a23f8b3932',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.027264] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-21049d56-f228-42f2-ae78-92a23f8b3932 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.027466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.027735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.027925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.028205] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.029335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.029335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.029335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.029335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.029335] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21049d56-f228-42f2-ae78-92a23f8b3932',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.031055] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-5c06ac76-b0f6-4907-b175-de58b2b40b26 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.031772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5c06ac76-b0f6-4907-b175-de58b2b40b26" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.031961] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5c06ac76-b0f6-4907-b175-de58b2b40b26" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.032806] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5c06ac76-b0f6-4907-b175-de58b2b40b26" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.032806] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5c06ac76-b0f6-4907-b175-de58b2b40b26',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.410375] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1172.410375] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.410787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.410787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.410862] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.411078] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.411175] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.411367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.411579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.411637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.411771] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.534523] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('21049d56-f228-42f2-ae78-92a23f8b3932',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.536195] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-21049d56-f228-42f2-ae78-92a23f8b3932 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.536307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.537025] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5c06ac76-b0f6-4907-b175-de58b2b40b26 with status ACTIVE [ 1172.537025] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.537025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.537025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.537025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.537239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.537269] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.537368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.538224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.538224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.538224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.538224] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.538224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.538224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.538490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.538490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.538621] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5c06ac76-b0f6-4907-b175-de58b2b40b26 is going to be updated. [ 1172.578533] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.578724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.578764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.579086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.579262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.579450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5c06ac76-b0f6-4907-b175-de58b2b40b26" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.915705] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.915705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.915705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.915705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.919181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.919181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.919181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.919181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.919181] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.940719] env[67003]: INFO networking_nsxv3.common.synchronization [req-13961fc2-0fb2-47a7-a760-0158b22df537 req-826faad5-5368-4fdf-84fa-943bb696722b tempest-AttachVolumeTestJSON-424960992 tempest-AttachVolumeTestJSON-424960992-project-member] Enqueued Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGHEST for action security_group_members [ 1172.940719] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGHEST for action security_group_members [ 1172.940719] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a73c2b37-9987-4ee9-8def-05a85741b451 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.940719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.940719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.943279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.943279] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.943279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.943279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.943666] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.943712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.943819] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.040990] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('21049d56-f228-42f2-ae78-92a23f8b3932',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.292762] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.292995] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-920" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.293133] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-920" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.293465] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-920" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.293733] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.294223] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.294223] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.294223] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.294394] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.294608] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.294743] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1173.294828] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1173.294933] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1173.295056] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.295160] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1173.295509] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1173.316281] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1173.316281] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1173.316281] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1173.316281] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-920" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.316555] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-31a2ce6c-efc8-44c5-bec2-9341abd73b38 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.316775] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-31a2ce6c-efc8-44c5-bec2-9341abd73b38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.316926] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-31a2ce6c-efc8-44c5-bec2-9341abd73b38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.317286] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-31a2ce6c-efc8-44c5-bec2-9341abd73b38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.317466] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a2ce6c-efc8-44c5-bec2-9341abd73b38',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.413704] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: SUCCESS [ 1173.414059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.422495] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f76f58af-f507-4428-b198-11ce6caf814d: rpc.has_security_group_logging(os_id): False [ 1173.446903] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.447119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.447119] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.447442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.447594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.449491] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.449491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.449491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.449491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.449491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.449491] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a73c2b37-9987-4ee9-8def-05a85741b451 already deleted. [ 1173.449491] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.459054] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.459213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.459280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.459484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.459576] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.459958] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.460096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.460167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.460345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.460433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.460683] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.460785] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.460850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.460994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.461133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.461433] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.461433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.461433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.461623] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.461623] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.461685] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1173.548257] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.548257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.548257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.548257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.548257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.548257] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21049d56-f228-42f2-ae78-92a23f8b3932 is going to be created. [ 1173.570071] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.570071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.570071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.570071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.570071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.589754] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1173.590725] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.590859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.590925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.591178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.591344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.602756] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21049d56-f228-42f2-ae78-92a23f8b3932 in Status: UNINITIALIZED for 2s [ 1173.824517] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.824749] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.824875] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.825176] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.825328] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.825486] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 31a2ce6c-efc8-44c5-bec2-9341abd73b38 not found, creating... [ 1173.825748] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.825942] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.826089] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.826327] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.826469] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.826767] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.826970] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.827128] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.827394] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.827565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.827722] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 31a2ce6c-efc8-44c5-bec2-9341abd73b38 is going to be created. [ 1173.849921] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.850324] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.850558] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.850906] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.851223] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.851510] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-31a2ce6c-efc8-44c5-bec2-9341abd73b38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.863445] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 in Status: SUCCESS [ 1173.863623] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 deletion is rescheduled due to dependency. [ 1173.863721] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.628641] env[67003]: INFO networking_nsxv3.common.synchronization [req-13961fc2-0fb2-47a7-a760-0158b22df537 req-3667ad25-c3e4-4e32-b9c7-7bfa26ec238e service nova] Enqueued Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGHEST for action security_group_rules [ 1174.628904] env[67003]: INFO networking_nsxv3.common.synchronization [req-13961fc2-0fb2-47a7-a760-0158b22df537 req-3667ad25-c3e4-4e32-b9c7-7bfa26ec238e service nova] Enqueued Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGHEST for action security_group_members [ 1174.629045] env[67003]: INFO networking_nsxv3.common.synchronization [req-13961fc2-0fb2-47a7-a760-0158b22df537 req-3667ad25-c3e4-4e32-b9c7-7bfa26ec238e service nova] Enqueued Resource ID: 31a2ce6c-efc8-44c5-bec2-9341abd73b38 with Priority: HIGHEST for action port [ 1174.629592] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGHEST for action security_group_rules [ 1174.629720] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGHEST for action security_group_members [ 1174.630010] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a2ce6c-efc8-44c5-bec2-9341abd73b38 with Priority: HIGHEST for action port [ 1174.630687] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a73c2b37-9987-4ee9-8def-05a85741b451 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.630687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.630687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.630994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.630994] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.632499] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a73c2b37-9987-4ee9-8def-05a85741b451 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.632667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.632757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.633087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.633281] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.633425] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.633512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.633690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.633799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.633909] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.635900] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-31a2ce6c-efc8-44c5-bec2-9341abd73b38 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.635900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31a2ce6c-efc8-44c5-bec2-9341abd73b38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.635900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31a2ce6c-efc8-44c5-bec2-9341abd73b38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.636127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31a2ce6c-efc8-44c5-bec2-9341abd73b38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.636176] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a2ce6c-efc8-44c5-bec2-9341abd73b38',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.133604] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a73c2b37-9987-4ee9-8def-05a85741b451 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.133832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.136777] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.138884] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 31a2ce6c-efc8-44c5-bec2-9341abd73b38 with status ACTIVE [ 1175.139135] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.141117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.141117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.141117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.141117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.141117] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.141117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.141117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.141117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.141117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.141117] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.141610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.141610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.141610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.141610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.141610] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 31a2ce6c-efc8-44c5-bec2-9341abd73b38 is going to be updated. [ 1175.168208] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.168457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.168560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.168878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.169113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.169355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31a2ce6c-efc8-44c5-bec2-9341abd73b38" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.603131] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1175.603316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.613964] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21049d56-f228-42f2-ae78-92a23f8b3932 in Status: SUCCESS [ 1175.614529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.614952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.615271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.615640] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.615892] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.616032] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.616300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.616419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.616554] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.616737] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('21049d56-f228-42f2-ae78-92a23f8b3932',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.643487] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.119629] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-21049d56-f228-42f2-ae78-92a23f8b3932 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.119629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.119629] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.122296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.122296] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.122296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.122296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.122296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.122296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.122296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.122604] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-21049d56-f228-42f2-ae78-92a23f8b3932 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.122604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.122604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.122701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.122883] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.122984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.123041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.127022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.127022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.127022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.127022] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('21049d56-f228-42f2-ae78-92a23f8b3932',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.146525] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.146743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.146822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.147050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.147134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.147229] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a73c2b37-9987-4ee9-8def-05a85741b451 is going to be created. [ 1176.178680] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.178928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.178928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.179124] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.179284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.195424] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a73c2b37-9987-4ee9-8def-05a85741b451 in Status: UNINITIALIZED for 2s [ 1176.626781] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 21049d56-f228-42f2-ae78-92a23f8b3932: rpc.has_security_group_logging(os_id): False [ 1176.649036] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.649036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.649036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.649036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.649036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.649036] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.649036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.649036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.649036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.649594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.649594] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.649594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.649594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.649594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.649747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.651064] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.651064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.651064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.651064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.651064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.651064] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21049d56-f228-42f2-ae78-92a23f8b3932 is going to be created. [ 1176.719947] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.719947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.719947] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.720909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.720909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.756201] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21049d56-f228-42f2-ae78-92a23f8b3932 in Status: IN_PROGRESS for 2s [ 1178.205600] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a73c2b37-9987-4ee9-8def-05a85741b451 in Status: SUCCESS [ 1178.205913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.206330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.206546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.206738] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.206856] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.206923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.207091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.207171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.207348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.207348] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.709605] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.771431] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 21049d56-f228-42f2-ae78-92a23f8b3932 in Status: SUCCESS [ 1178.771997] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.100427] env[67003]: INFO networking_nsxv3.common.synchronization [None req-9f6c0001-10c6-4c43-b7f2-098326751e73 None None] Enqueued Resource ID: adfe42b4-7346-4f10-a89f-b2d030e689d1 with Priority: HIGHEST for action port [ 1179.101022] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adfe42b4-7346-4f10-a89f-b2d030e689d1 with Priority: HIGHEST for action port [ 1179.101340] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-adfe42b4-7346-4f10-a89f-b2d030e689d1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.104126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adfe42b4-7346-4f10-a89f-b2d030e689d1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.104126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adfe42b4-7346-4f10-a89f-b2d030e689d1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.104126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adfe42b4-7346-4f10-a89f-b2d030e689d1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.104126] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adfe42b4-7346-4f10-a89f-b2d030e689d1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.212409] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a73c2b37-9987-4ee9-8def-05a85741b451: rpc.has_security_group_logging(os_id): False [ 1179.234859] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.235067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.235188] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.236038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.236241] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.237837] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.237968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.238061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.238253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.239134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.239279] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a73c2b37-9987-4ee9-8def-05a85741b451 is going to be created. [ 1179.309956] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.309956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.309956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.309956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.309956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.322125] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a73c2b37-9987-4ee9-8def-05a85741b451 in Status: IN_PROGRESS for 2s [ 1179.605166] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port adfe42b4-7346-4f10-a89f-b2d030e689d1 [ 1179.605302] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.607146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.607308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.608209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.608209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.608209] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:adfe42b4-7346-4f10-a89f-b2d030e689d1 already deleted. [ 1179.608359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adfe42b4-7346-4f10-a89f-b2d030e689d1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.140887] env[67003]: INFO networking_nsxv3.common.synchronization [req-d442773f-cc22-4a5f-964a-69fffac7668d req-35014caf-b849-4ad6-8255-1bc78cef1d8b tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1180.141460] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1180.142405] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.142405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.142405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.144269] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.144453] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.144559] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.144663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.144841] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.144952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.145062] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.647351] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.151035] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.334978] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a73c2b37-9987-4ee9-8def-05a85741b451 in Status: SUCCESS [ 1181.335345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.544022] env[67003]: INFO networking_nsxv3.common.synchronization [None req-a0726871-edfc-440b-81a0-0a2a82c7e517 None None] Enqueued Resource ID: 83371475-2d1c-4b3f-8b00-8dae573239e2 with Priority: HIGHEST for action port [ 1181.544022] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83371475-2d1c-4b3f-8b00-8dae573239e2 with Priority: HIGHEST for action port [ 1181.544022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-83371475-2d1c-4b3f-8b00-8dae573239e2 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.544022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83371475-2d1c-4b3f-8b00-8dae573239e2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.544022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83371475-2d1c-4b3f-8b00-8dae573239e2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.544613] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83371475-2d1c-4b3f-8b00-8dae573239e2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.545392] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83371475-2d1c-4b3f-8b00-8dae573239e2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.655010] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.655010] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.655010] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.655010] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.655010] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.655010] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1181.683017] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.683143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.683143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.683379] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.683530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.692987] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1182.048468] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 83371475-2d1c-4b3f-8b00-8dae573239e2 [ 1182.048584] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.048684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.048684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.049487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.049487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.049487] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:83371475-2d1c-4b3f-8b00-8dae573239e2 already deleted. [ 1182.049487] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83371475-2d1c-4b3f-8b00-8dae573239e2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.058829] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ab397511-ab19-444c-b6b9-80d294c98a45 None None] Enqueued Resource ID: 79b315b7-4cd6-4f2d-93b8-b6d0b4fc68b9 with Priority: HIGHEST for action port [ 1182.059346] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79b315b7-4cd6-4f2d-93b8-b6d0b4fc68b9 with Priority: HIGHEST for action port [ 1182.059667] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-79b315b7-4cd6-4f2d-93b8-b6d0b4fc68b9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.059796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79b315b7-4cd6-4f2d-93b8-b6d0b4fc68b9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.059866] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79b315b7-4cd6-4f2d-93b8-b6d0b4fc68b9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.060126] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79b315b7-4cd6-4f2d-93b8-b6d0b4fc68b9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.060210] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79b315b7-4cd6-4f2d-93b8-b6d0b4fc68b9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.562407] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 79b315b7-4cd6-4f2d-93b8-b6d0b4fc68b9 [ 1182.566760] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.566760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.566760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.566760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.566760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.566760] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:79b315b7-4cd6-4f2d-93b8-b6d0b4fc68b9 already deleted. [ 1182.566760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79b315b7-4cd6-4f2d-93b8-b6d0b4fc68b9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.708211] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1183.708211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.254266] env[67003]: INFO networking_nsxv3.common.synchronization [None req-3a7da9ba-388f-4cd4-b6ce-5ca2e2db67fd None None] Enqueued Resource ID: 05d6a353-af7d-49c9-85af-d024dac05949 with Priority: HIGHEST for action port [ 1184.254571] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05d6a353-af7d-49c9-85af-d024dac05949 with Priority: HIGHEST for action port [ 1184.255100] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-05d6a353-af7d-49c9-85af-d024dac05949 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.255232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-05d6a353-af7d-49c9-85af-d024dac05949" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.255291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-05d6a353-af7d-49c9-85af-d024dac05949" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.255715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-05d6a353-af7d-49c9-85af-d024dac05949" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.255919] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('05d6a353-af7d-49c9-85af-d024dac05949',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.757987] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 05d6a353-af7d-49c9-85af-d024dac05949 [ 1184.758418] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.758418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.758533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.758726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.758856] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.758960] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:05d6a353-af7d-49c9-85af-d024dac05949 already deleted. [ 1184.759057] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-05d6a353-af7d-49c9-85af-d024dac05949" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.962845] env[67003]: INFO networking_nsxv3.common.synchronization [req-27f2b01c-e752-4004-a2f9-40b59694897e req-21dd4d7b-4eba-4405-8c66-56c3bb0df8bf tempest-ServersNegativeTestMultiTenantJSON-460066527 tempest-ServersNegativeTestMultiTenantJSON-460066527-project-member] Enqueued Resource ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb with Priority: HIGHEST for action security_group_members [ 1187.964047] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb with Priority: HIGHEST for action security_group_members [ 1187.964415] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.964551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.964623] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.964899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.965071] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.965372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.965524] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.965688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.965773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.965868] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14acdd23-bebb-4c9b-ad3a-42f438a0a5eb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.272374] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.272582] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-608" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.272728] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-608" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.273051] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-608" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.273642] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.273839] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.273974] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.274207] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.274352] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.274560] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.274676] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1188.274781] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1188.274889] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1188.274996] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1188.275111] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1188.275240] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1188.294311] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1188.294463] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1188.294592] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1188.294763] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-608" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.295213] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-6437507d-3c3a-4c8f-a56c-fb0a150d1747 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.295412] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-6437507d-3c3a-4c8f-a56c-fb0a150d1747" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.295549] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-6437507d-3c3a-4c8f-a56c-fb0a150d1747" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.295861] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-6437507d-3c3a-4c8f-a56c-fb0a150d1747" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.295999] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6437507d-3c3a-4c8f-a56c-fb0a150d1747',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.469546] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.469546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.469546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.469546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.469546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.469546] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.469546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.469546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.469546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.469546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.470045] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb already deleted. [ 1188.470284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.771702] env[67003]: INFO networking_nsxv3.common.synchronization [req-23d5de88-97a6-4545-8569-e760ba4e8610 req-b9290c1c-75e9-4be9-95ad-5c9cd9517dcb tempest-InstanceActionsTestJSON-214993564 tempest-InstanceActionsTestJSON-214993564-project-member] Enqueued Resource ID: 21049d56-f228-42f2-ae78-92a23f8b3932 with Priority: HIGHEST for action security_group_members [ 1188.772306] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21049d56-f228-42f2-ae78-92a23f8b3932 with Priority: HIGHEST for action security_group_members [ 1188.772625] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-21049d56-f228-42f2-ae78-92a23f8b3932 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.773031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.773031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.773031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.773171] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.773258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.773377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.773461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.773548] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.773642] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('21049d56-f228-42f2-ae78-92a23f8b3932',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.798541] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.798819] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.798950] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.799276] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.799474] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.799649] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 6437507d-3c3a-4c8f-a56c-fb0a150d1747 not found, creating... [ 1188.799933] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.800109] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.800228] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.800460] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.800607] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.800917] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.801090] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.801200] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.801425] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.801567] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.801731] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 6437507d-3c3a-4c8f-a56c-fb0a150d1747 is going to be created. [ 1188.826554] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.826776] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.826884] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.827187] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.827416] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.827758] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-6437507d-3c3a-4c8f-a56c-fb0a150d1747" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.275573] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.275872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.275872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.279019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.279019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.279019] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.279019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.279019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.279019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.279019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.279019] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21049d56-f228-42f2-ae78-92a23f8b3932 is going to be updated. [ 1189.302691] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.302928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.302928] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.303138] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.303577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.317571] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21049d56-f228-42f2-ae78-92a23f8b3932 in Status: IN_PROGRESS for 2s [ 1189.544762] env[67003]: INFO networking_nsxv3.common.synchronization [req-27f2b01c-e752-4004-a2f9-40b59694897e req-6f837037-f93d-445a-ab7e-6ef98bd7f486 service nova] Enqueued Resource ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb with Priority: HIGHEST for action security_group_rules [ 1189.544965] env[67003]: INFO networking_nsxv3.common.synchronization [req-27f2b01c-e752-4004-a2f9-40b59694897e req-6f837037-f93d-445a-ab7e-6ef98bd7f486 service nova] Enqueued Resource ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb with Priority: HIGHEST for action security_group_members [ 1189.545117] env[67003]: INFO networking_nsxv3.common.synchronization [req-27f2b01c-e752-4004-a2f9-40b59694897e req-6f837037-f93d-445a-ab7e-6ef98bd7f486 service nova] Enqueued Resource ID: 6437507d-3c3a-4c8f-a56c-fb0a150d1747 with Priority: HIGHEST for action port [ 1189.545673] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb with Priority: HIGHEST for action security_group_rules [ 1189.545812] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb with Priority: HIGHEST for action security_group_members [ 1189.545909] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6437507d-3c3a-4c8f-a56c-fb0a150d1747 with Priority: HIGHEST for action port [ 1189.546486] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.546638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.546728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.547040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.547158] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14acdd23-bebb-4c9b-ad3a-42f438a0a5eb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.548976] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.548976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.548976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.548976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.548976] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.548976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.548976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.548976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.548976] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.548976] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14acdd23-bebb-4c9b-ad3a-42f438a0a5eb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.549791] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-6437507d-3c3a-4c8f-a56c-fb0a150d1747 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.549932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6437507d-3c3a-4c8f-a56c-fb0a150d1747" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.550738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6437507d-3c3a-4c8f-a56c-fb0a150d1747" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.550738] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6437507d-3c3a-4c8f-a56c-fb0a150d1747" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.551699] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6437507d-3c3a-4c8f-a56c-fb0a150d1747',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.053845] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.053998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.054181] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14acdd23-bebb-4c9b-ad3a-42f438a0a5eb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.055101] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6437507d-3c3a-4c8f-a56c-fb0a150d1747 with status ACTIVE [ 1190.055313] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.055451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.055523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.057102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.057102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.057102] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.057102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.057102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.057102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.057102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.057102] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.057102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.057102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.057102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.057102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.057102] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6437507d-3c3a-4c8f-a56c-fb0a150d1747 is going to be updated. [ 1190.081085] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.081254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.081328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.081560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.081703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.082089] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6437507d-3c3a-4c8f-a56c-fb0a150d1747" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.559705] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14acdd23-bebb-4c9b-ad3a-42f438a0a5eb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.062096] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.062096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.062096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.062368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.062368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.062431] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb is going to be created. [ 1191.087268] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.087419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.087545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.087741] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.087935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.100504] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb in Status: UNINITIALIZED for 2s [ 1191.327510] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 21049d56-f228-42f2-ae78-92a23f8b3932 in Status: SUCCESS [ 1191.327817] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 21049d56-f228-42f2-ae78-92a23f8b3932 deletion is rescheduled due to dependency. [ 1191.327972] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.112328] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb in Status: SUCCESS [ 1193.112613] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.112668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.112857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.113065] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.113187] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.113253] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.113419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.113521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.113633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.113731] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14acdd23-bebb-4c9b-ad3a-42f438a0a5eb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.413336] env[67003]: INFO networking_nsxv3.common.synchronization [req-299e11cb-fdf9-4909-ad44-a335d1680cab req-8ccf7cf3-0821-4cb5-90f8-ca2b14e8d825 tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1193.413909] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1193.414260] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.414525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.414525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.414715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.414886] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.415031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.415209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.415398] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.415509] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.415639] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.616289] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.616439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.616503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.616691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.616860] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.616948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.617022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.617234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.617307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.617356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.617534] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.617631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.617691] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.617999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.617999] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.618106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.618285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.618318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.618406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.618526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.618647] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14acdd23-bebb-4c9b-ad3a-42f438a0a5eb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.697981] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-201 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.697981] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.697981] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.697981] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.699856] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.699856] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.699856] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.700045] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.700078] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.700274] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.700384] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1193.700491] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1193.700648] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1193.700779] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1193.700888] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1193.701028] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1193.720885] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1193.721151] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1193.721309] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1193.721812] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-201" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.722121] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-5dd206f9-528b-40b5-8c62-2bcb487e0ea0 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.722325] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-5dd206f9-528b-40b5-8c62-2bcb487e0ea0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.722415] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-5dd206f9-528b-40b5-8c62-2bcb487e0ea0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.723055] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-5dd206f9-528b-40b5-8c62-2bcb487e0ea0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.723055] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dd206f9-528b-40b5-8c62-2bcb487e0ea0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.917385] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.121258] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb: rpc.has_security_group_logging(os_id): False [ 1194.140771] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.140987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.141054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.141264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.141378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.141549] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.141661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.141725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.141866] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.141943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.142827] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.142827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.142827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.142827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.142827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.142827] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.143152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.143152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.143152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.143152] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.143273] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb is going to be created. [ 1194.200904] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.201059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.201114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.201302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.201480] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.214158] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb in Status: IN_PROGRESS for 2s [ 1194.225541] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.225691] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.225737] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.227297] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.227297] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.227297] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 5dd206f9-528b-40b5-8c62-2bcb487e0ea0 not found, creating... [ 1194.227297] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.227297] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.227297] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.228051] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.228281] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.229026] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.229026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.229026] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.229245] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.229385] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.229841] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 5dd206f9-528b-40b5-8c62-2bcb487e0ea0 is going to be created. [ 1194.254819] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.255085] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.255194] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.255567] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.255859] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.256159] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-5dd206f9-528b-40b5-8c62-2bcb487e0ea0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.420098] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.922509] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.922509] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.922909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.923551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.923551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.923551] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1194.958211] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.958619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.958619] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.958751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.958853] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.968367] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1194.994585] env[67003]: INFO networking_nsxv3.common.synchronization [req-299e11cb-fdf9-4909-ad44-a335d1680cab req-c9aa2db0-3bff-4c54-a26c-14ee68fa4786 service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1194.994879] env[67003]: INFO networking_nsxv3.common.synchronization [req-299e11cb-fdf9-4909-ad44-a335d1680cab req-c9aa2db0-3bff-4c54-a26c-14ee68fa4786 service nova] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1194.994976] env[67003]: INFO networking_nsxv3.common.synchronization [req-299e11cb-fdf9-4909-ad44-a335d1680cab req-c9aa2db0-3bff-4c54-a26c-14ee68fa4786 service nova] Enqueued Resource ID: 5dd206f9-528b-40b5-8c62-2bcb487e0ea0 with Priority: HIGHEST for action port [ 1194.995570] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_rules [ 1194.995719] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1194.995819] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5dd206f9-528b-40b5-8c62-2bcb487e0ea0 with Priority: HIGHEST for action port [ 1194.996116] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.996223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.996291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.996490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.996572] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.997432] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.997587] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.998298] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-5dd206f9-528b-40b5-8c62-2bcb487e0ea0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.998298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5dd206f9-528b-40b5-8c62-2bcb487e0ea0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.998298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5dd206f9-528b-40b5-8c62-2bcb487e0ea0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.998298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5dd206f9-528b-40b5-8c62-2bcb487e0ea0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.998298] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5dd206f9-528b-40b5-8c62-2bcb487e0ea0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.501095] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.502286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.502286] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5dd206f9-528b-40b5-8c62-2bcb487e0ea0 with status ACTIVE [ 1195.502436] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.502762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.502762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.502762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.502929] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.503116] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.503203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.503316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.504240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.504240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.504240] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.504240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.504240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.504240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.504240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.504240] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5dd206f9-528b-40b5-8c62-2bcb487e0ea0 is going to be updated. [ 1195.524633] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.524633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.524744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.528020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.528020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.528020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5dd206f9-528b-40b5-8c62-2bcb487e0ea0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.227186] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb in Status: SUCCESS [ 1196.227341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.978497] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1196.979077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.979077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.979156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.979344] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.980157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.980157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.980157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.980157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.980157] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.483321] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.987154] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.490298] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.490501] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.490501] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.490739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.490821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.490966] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1198.528230] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.528443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.528665] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.528828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.529839] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.538866] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1198.693614] env[67003]: INFO networking_nsxv3.common.synchronization [req-70bb97f7-5cea-4afe-b8af-64d7f53e4a1b req-4eeb0c53-73db-4bab-b2ba-49d2614d5313 tempest-ServersNegativeTestMultiTenantJSON-460066527 tempest-ServersNegativeTestMultiTenantJSON-460066527-project-member] Enqueued Resource ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb with Priority: HIGHEST for action security_group_members [ 1198.694553] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb with Priority: HIGHEST for action security_group_members [ 1198.694874] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.694990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.695071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.695315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.695471] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.695567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.695660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.695787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.695875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.696069] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14acdd23-bebb-4c9b-ad3a-42f438a0a5eb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.186894] env[67003]: INFO networking_nsxv3.common.synchronization [None req-c67feb50-3cfa-4a92-a077-efd5963750f7 None None] Enqueued Resource ID: 42465c7f-5198-4d2d-b7ae-e30e20f08300 with Priority: HIGHEST for action port [ 1199.187233] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42465c7f-5198-4d2d-b7ae-e30e20f08300 with Priority: HIGHEST for action port [ 1199.187796] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-42465c7f-5198-4d2d-b7ae-e30e20f08300 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.187917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42465c7f-5198-4d2d-b7ae-e30e20f08300" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.188033] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42465c7f-5198-4d2d-b7ae-e30e20f08300" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.188286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42465c7f-5198-4d2d-b7ae-e30e20f08300" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.188370] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42465c7f-5198-4d2d-b7ae-e30e20f08300',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.198498] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.198722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.198834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.199099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.199223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.199463] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.199603] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.199699] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.199917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.200040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.200165] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb is going to be updated. [ 1199.228612] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.228792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.228920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.229043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.229191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.238109] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb in Status: IN_PROGRESS for 2s [ 1199.693023] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42465c7f-5198-4d2d-b7ae-e30e20f08300 [ 1199.693023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.693023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.693023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.693023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.693023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.693023] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42465c7f-5198-4d2d-b7ae-e30e20f08300 already deleted. [ 1199.693023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42465c7f-5198-4d2d-b7ae-e30e20f08300" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.549945] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1200.550233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.550357] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.550653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.550859] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.550978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.551058] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.551226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.551305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.551390] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.551480] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.054020] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.054260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.054388] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.055381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.055381] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.055381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.055381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.055381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.055381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.055635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.055635] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.055703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.055793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.055887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.056040] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.056132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.056190] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.056324] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.056395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.056472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.056555] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.249282] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb in Status: SUCCESS [ 1201.249458] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb deletion is rescheduled due to dependency. [ 1201.249594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.559449] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f76f58af-f507-4428-b198-11ce6caf814d: rpc.has_security_group_logging(os_id): False [ 1201.579062] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.579062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.579062] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.579291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.579291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.579447] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.579547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.579611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.579759] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.579867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.580066] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.580161] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.580223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.580360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.580435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.580616] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.580711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.580771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.580909] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.580981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.581118] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1201.653704] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.654199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.654555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.654998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.656021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.687127] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1201.894061] env[67003]: INFO networking_nsxv3.common.synchronization [None req-c2044969-c6ba-452f-81cf-23cf4d8e144f None None] Enqueued Resource ID: 9686d6b2-ff40-463e-902c-2d9c860111b5 with Priority: HIGHEST for action port [ 1201.894206] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9686d6b2-ff40-463e-902c-2d9c860111b5 with Priority: HIGHEST for action port [ 1201.894468] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-9686d6b2-ff40-463e-902c-2d9c860111b5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.894637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9686d6b2-ff40-463e-902c-2d9c860111b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.894822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9686d6b2-ff40-463e-902c-2d9c860111b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.895040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9686d6b2-ff40-463e-902c-2d9c860111b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.895151] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9686d6b2-ff40-463e-902c-2d9c860111b5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.397748] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9686d6b2-ff40-463e-902c-2d9c860111b5 [ 1202.398017] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.398165] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.398233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.398445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.398622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.398780] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9686d6b2-ff40-463e-902c-2d9c860111b5 already deleted. [ 1202.398890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9686d6b2-ff40-463e-902c-2d9c860111b5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.705821] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1203.705821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.301221] env[67003]: INFO networking_nsxv3.common.synchronization [req-be3958c0-0310-4fe7-836e-15901f788226 req-454c05ef-bf02-4a1b-8899-3eed1c5367f7 tempest-MultipleCreateTestJSON-291625432 tempest-MultipleCreateTestJSON-291625432-project-member] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1205.301509] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1205.301960] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.301960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.301960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.302252] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.302411] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.302513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.302577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.302729] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.302830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.302923] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.697130] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-242 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.697226] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.697388] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.697918] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.698288] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.698658] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.698658] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.698842] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.698990] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.699240] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1205.699352] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1205.699492] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1205.699690] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1205.699903] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1205.699963] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1205.700108] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1205.721357] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1205.721814] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1205.721814] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1205.721945] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.722303] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-94a8e327-7b5e-4d5f-a65c-d998f64a99b7 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.722505] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-94a8e327-7b5e-4d5f-a65c-d998f64a99b7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.722683] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-94a8e327-7b5e-4d5f-a65c-d998f64a99b7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.723021] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-94a8e327-7b5e-4d5f-a65c-d998f64a99b7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.723187] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94a8e327-7b5e-4d5f-a65c-d998f64a99b7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.805508] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.805827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.805915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.806162] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.806257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.806524] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.806703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.806775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.806951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.807044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.807138] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 already deleted. [ 1205.807219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.225712] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.225982] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.226126] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.226399] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.226569] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.226700] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 94a8e327-7b5e-4d5f-a65c-d998f64a99b7 not found, creating... [ 1206.226970] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.227197] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.227316] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.227533] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.227842] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.228367] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.228668] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.228936] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.229314] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.229480] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.229647] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 94a8e327-7b5e-4d5f-a65c-d998f64a99b7 is going to be created. [ 1206.252347] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.252589] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.252746] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.253068] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.253476] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.253733] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-94a8e327-7b5e-4d5f-a65c-d998f64a99b7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.163409] env[67003]: INFO networking_nsxv3.common.synchronization [req-be3958c0-0310-4fe7-836e-15901f788226 req-96f3e1fa-17af-4c3b-8794-ab7409806c30 service nova] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_rules [ 1207.163849] env[67003]: INFO networking_nsxv3.common.synchronization [req-be3958c0-0310-4fe7-836e-15901f788226 req-96f3e1fa-17af-4c3b-8794-ab7409806c30 service nova] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1207.163849] env[67003]: INFO networking_nsxv3.common.synchronization [req-be3958c0-0310-4fe7-836e-15901f788226 req-96f3e1fa-17af-4c3b-8794-ab7409806c30 service nova] Enqueued Resource ID: 94a8e327-7b5e-4d5f-a65c-d998f64a99b7 with Priority: HIGHEST for action port [ 1207.165053] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_rules [ 1207.165259] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1207.165302] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94a8e327-7b5e-4d5f-a65c-d998f64a99b7 with Priority: HIGHEST for action port [ 1207.165644] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.165772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.166164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.166427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.166490] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.167786] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.167917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.167984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.168274] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.168433] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.168552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.168625] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.168723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.168809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.168903] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.173732] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-94a8e327-7b5e-4d5f-a65c-d998f64a99b7 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.173884] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94a8e327-7b5e-4d5f-a65c-d998f64a99b7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.173971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94a8e327-7b5e-4d5f-a65c-d998f64a99b7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.174127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94a8e327-7b5e-4d5f-a65c-d998f64a99b7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.174211] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94a8e327-7b5e-4d5f-a65c-d998f64a99b7',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.675077] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.676362] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94a8e327-7b5e-4d5f-a65c-d998f64a99b7 with status ACTIVE [ 1207.676362] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.676471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.676502] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.677109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.677109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.677109] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.677109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.677109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.677447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.677447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.677502] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.677609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.677711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.678408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.678408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.678408] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94a8e327-7b5e-4d5f-a65c-d998f64a99b7 is going to be updated. [ 1207.679527] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.679527] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.702119] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.702272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.702346] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.702599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.702696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.702854] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94a8e327-7b5e-4d5f-a65c-d998f64a99b7" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.742035] env[67003]: INFO networking_nsxv3.common.synchronization [req-be3958c0-0310-4fe7-836e-15901f788226 req-7138ef6d-a284-4ad5-8baa-b3ed9d8e274b tempest-MultipleCreateTestJSON-291625432 tempest-MultipleCreateTestJSON-291625432-project-member] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1207.742035] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1207.742035] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.742035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.104250] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-242 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.104488] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.104580] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.104932] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.105216] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.105441] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.105594] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.105813] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.105961] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.106190] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.106300] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1208.106409] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1208.106517] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1208.106627] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.106739] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1208.106899] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1208.126026] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1208.126026] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1208.126026] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1208.126279] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.126650] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-ff2d6968-888b-426f-b1fa-53f2412c36d0 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.126849] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-ff2d6968-888b-426f-b1fa-53f2412c36d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.126971] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-ff2d6968-888b-426f-b1fa-53f2412c36d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.127464] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-ff2d6968-888b-426f-b1fa-53f2412c36d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.127713] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff2d6968-888b-426f-b1fa-53f2412c36d0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.181063] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.629825] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.630123] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.630256] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.630578] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.630771] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.630939] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port ff2d6968-888b-426f-b1fa-53f2412c36d0 not found, creating... [ 1208.631237] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.631400] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.631516] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.631810] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.631975] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.632913] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.633222] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.633459] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.633805] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.634011] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.634228] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: ff2d6968-888b-426f-b1fa-53f2412c36d0 is going to be created. [ 1208.655655] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.655976] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.656148] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.656439] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.656679] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.656914] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-ff2d6968-888b-426f-b1fa-53f2412c36d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.683993] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.684201] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.684255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.684484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.684638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.684742] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be created. [ 1208.731880] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.732050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.732167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.732445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.732635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.742695] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: UNINITIALIZED for 2s [ 1209.434591] env[67003]: INFO networking_nsxv3.common.synchronization [req-be3958c0-0310-4fe7-836e-15901f788226 req-7ce053bc-e6e8-47c6-8053-cb4820f62c65 service nova] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_rules [ 1209.434913] env[67003]: INFO networking_nsxv3.common.synchronization [req-be3958c0-0310-4fe7-836e-15901f788226 req-7ce053bc-e6e8-47c6-8053-cb4820f62c65 service nova] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1209.435124] env[67003]: INFO networking_nsxv3.common.synchronization [req-be3958c0-0310-4fe7-836e-15901f788226 req-7ce053bc-e6e8-47c6-8053-cb4820f62c65 service nova] Enqueued Resource ID: ff2d6968-888b-426f-b1fa-53f2412c36d0 with Priority: HIGHEST for action port [ 1209.435945] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_rules [ 1209.436143] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1209.436279] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff2d6968-888b-426f-b1fa-53f2412c36d0 with Priority: HIGHEST for action port [ 1209.436726] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.436902] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.437222] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.437368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.437727] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff2d6968-888b-426f-b1fa-53f2412c36d0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.437822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff2d6968-888b-426f-b1fa-53f2412c36d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.437875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff2d6968-888b-426f-b1fa-53f2412c36d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.438231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff2d6968-888b-426f-b1fa-53f2412c36d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.438332] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff2d6968-888b-426f-b1fa-53f2412c36d0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.940398] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff2d6968-888b-426f-b1fa-53f2412c36d0 with status ACTIVE [ 1209.940635] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.940772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.940863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.941087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.941180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.941371] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.941454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.941511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.941663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.941769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.941962] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.942082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.942153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.942308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.942394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.942478] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff2d6968-888b-426f-b1fa-53f2412c36d0 is going to be updated. [ 1209.966322] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.966821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.966821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.967037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.967211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.968068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff2d6968-888b-426f-b1fa-53f2412c36d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.753743] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: SUCCESS [ 1210.754098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.754235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.754461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.754652] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.754773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.754840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.755076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.755149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.755242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.755339] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.756206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.756370] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.756526] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.756628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.756694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.756846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.756955] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.757089] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.260524] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.260781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.261079] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.763885] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.266015] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.266154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.266196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.266908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.266908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.266908] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be updated. [ 1212.298702] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.299090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.299165] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.299377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.299530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.323088] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: IN_PROGRESS for 2s [ 1212.537220] env[67003]: INFO networking_nsxv3.common.synchronization [req-454ba64e-abfb-4cc0-b7f7-d2af0b1be893 req-b93c1759-9ded-449b-b092-2057eb16c77f tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1212.537220] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1212.537296] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.537450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.537503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.537723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.537888] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.537979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.538053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.538204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.538301] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.538398] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.041020] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.544093] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.046147] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.046534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.046534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.046641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.046698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.046814] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1214.076212] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.076412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.076412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.076655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.076816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.086616] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1214.332882] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: SUCCESS [ 1214.333123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.333290] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.333598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.333760] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.333888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.333954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.334144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.334224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.334323] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.837401] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.341913] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.844566] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.844737] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.844802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.845046] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.845136] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.845234] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be updated. [ 1215.875055] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.875289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.875289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.875485] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.875717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.886118] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: IN_PROGRESS for 2s [ 1216.098246] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1216.098410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.538571] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1217.538858] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1217.898880] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: SUCCESS [ 1217.898880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.898880] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.899224] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.899420] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.899535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.899636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.899775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.899910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.900025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.900201] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.900291] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.900358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.900493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.900636] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.900726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.900775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.900913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.900993] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.901083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.901175] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.403357] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e58b8643-f9c9-4a73-8e5a-fd47e5555807: rpc.has_security_group_logging(os_id): False [ 1218.423250] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.423705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.424059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.424550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.424550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.424707] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.424944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.425068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.425275] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.425378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.425588] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.425703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.425772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.425920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.426031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.426221] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.426336] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.426420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.426602] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.426695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.426786] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be created. [ 1218.507986] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.508347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.508530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.508809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.509061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.521756] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: IN_PROGRESS for 2s [ 1220.207938] env[67003]: INFO networking_nsxv3.common.synchronization [req-af282144-61c9-4472-a843-b8213143a3ae req-e462f956-a50c-49d2-bf55-514fa1154a64 tempest-MultipleCreateTestJSON-291625432 tempest-MultipleCreateTestJSON-291625432-project-member] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1220.207938] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1220.207938] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.207938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.207938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.207938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.207938] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.207938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.207938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.207938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.207938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.208552] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.226319] env[67003]: INFO networking_nsxv3.common.synchronization [req-7f374180-c900-4f14-85d3-7d4314c24152 req-c970758d-1803-4ff7-91fb-fd0f1cff1f72 tempest-MultipleCreateTestJSON-291625432 tempest-MultipleCreateTestJSON-291625432-project-member] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1220.227204] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1220.227204] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.227204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.535807] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: SUCCESS [ 1220.536056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.536235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.537440] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.537575] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.711181] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.711372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.711417] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.711614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.711717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.711909] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.712014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.712083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.712233] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.712312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.712398] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be updated. [ 1220.739440] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.739599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.739661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.739867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.740045] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.748725] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: IN_PROGRESS for 2s [ 1221.073903] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.074145] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.074239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.074527] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.074655] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.074794] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be deleted. [ 1221.126100] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.126334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.126407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.126576] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.126673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.126808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.784946] env[67003]: INFO networking_nsxv3.common.synchronization [req-fd0930a7-ab09-4637-b3eb-2601629dcd87 req-dd207c98-2347-4911-9c57-07c09978d627 tempest-ServersTestJSON-223311439 tempest-ServersTestJSON-223311439-project-member] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1221.785515] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGHEST for action security_group_members [ 1221.789596] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.790008] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.790095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.790314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.790522] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.790593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.790658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.790813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.790901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.790999] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.293962] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.294293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.294404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.294659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.294871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.295225] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.295377] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.295511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.295729] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.295855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.295982] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be updated. [ 1222.323738] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.323935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.324085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.324359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.324560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.344190] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: IN_PROGRESS for 2s [ 1222.765077] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: SUCCESS [ 1222.765077] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 deletion is rescheduled due to dependency. [ 1222.765299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.765383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.765611] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.765803] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.765921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.765987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.766160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.766289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.766342] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.270153] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.270452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.270452] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.270570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.270659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.270860] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.271289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.271289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.271289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.271289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.271548] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be deleted. [ 1223.301725] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.301868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.301938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.302172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.302264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.302366] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.353857] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f76f58af-f507-4428-b198-11ce6caf814d in Status: SUCCESS [ 1224.354111] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f76f58af-f507-4428-b198-11ce6caf814d deletion is rescheduled due to dependency. [ 1224.354216] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.786394] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1226.786761] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1231.104245] env[67003]: INFO networking_nsxv3.common.synchronization [req-eec167b3-5514-4933-aaec-f41200b8ad3c req-46b77996-0fee-40bc-b30a-87245769b7f9 tempest-ServerActionsTestJSON-1949922754 tempest-ServerActionsTestJSON-1949922754-project-member] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1231.104832] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1231.105167] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.105312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.105365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.105544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.105699] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.105831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.105863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.105989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.106086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.106181] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.609061] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.609061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.609061] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.609333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.609371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.609576] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.609686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.609764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.609941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.610031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.610146] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 is going to be updated. [ 1231.641451] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.641686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.641835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.642179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.642411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.652051] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: IN_PROGRESS for 2s [ 1233.666058] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: SUCCESS [ 1233.666467] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 deletion is rescheduled due to dependency. [ 1233.666467] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.045405] env[67003]: INFO networking_nsxv3.common.synchronization [req-f7395389-430f-490c-be78-8b4e69fbe0cc req-02e73562-4706-49f3-83a6-809048e08cd1 tempest-MultipleCreateTestJSON-291625432 tempest-MultipleCreateTestJSON-291625432-project-member] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1234.046163] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1234.046596] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.046766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.046869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.047154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.047381] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.047522] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.047615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.047858] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.047965] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.048113] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.411745] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-242 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.411959] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.412116] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.412393] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.412665] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.412826] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.412944] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.413192] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.413340] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.413555] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1234.413668] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1234.413779] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1234.413889] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1234.414009] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1234.414142] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1234.414287] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1234.435138] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1234.435377] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1234.435546] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1234.435778] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.436150] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.436424] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.436553] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.437189] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.437345] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1234.551271] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.551492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.551492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.551771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.552027] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.552257] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.552371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.552437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.552643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.552873] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.553088] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 already deleted. [ 1234.553323] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.942259] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.942692] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.942692] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.942904] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.943115] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.943287] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a not found, creating... [ 1234.943575] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.943873] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.944059] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.944322] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.944478] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.944837] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.944995] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.945140] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.945371] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.945522] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.945670] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a is going to be created. [ 1234.971311] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.971588] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.971652] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.971916] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.972168] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.972396] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.684351] env[67003]: INFO networking_nsxv3.common.synchronization [req-f7395389-430f-490c-be78-8b4e69fbe0cc req-8c9e7ad8-bb21-4e26-b797-3c775580a22e service nova] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_rules [ 1235.684530] env[67003]: INFO networking_nsxv3.common.synchronization [req-f7395389-430f-490c-be78-8b4e69fbe0cc req-8c9e7ad8-bb21-4e26-b797-3c775580a22e service nova] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1235.684669] env[67003]: INFO networking_nsxv3.common.synchronization [req-f7395389-430f-490c-be78-8b4e69fbe0cc req-8c9e7ad8-bb21-4e26-b797-3c775580a22e service nova] Enqueued Resource ID: ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a with Priority: HIGHEST for action port [ 1235.685644] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_rules [ 1235.685839] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1235.685949] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a with Priority: HIGHEST for action port [ 1235.686209] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.686343] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.686420] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.686604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.686708] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.688995] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.689163] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.689196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.689448] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.689611] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.689898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.689898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.689958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.690100] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.690181] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.691147] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.691394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.691477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.691636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.691712] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.193981] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.193981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.194576] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.195228] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a with status ACTIVE [ 1236.195308] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.195444] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.195667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.195726] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.196369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.196369] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.196369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.196369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.196369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.196614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.196614] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.196688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.196733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.196868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.196962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.197076] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a is going to be updated. [ 1236.225914] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.226059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.226205] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.226340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.226484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.226646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddbde1ed-9933-42a0-9ae9-977fa6c5ae1a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.261575] env[67003]: INFO networking_nsxv3.common.synchronization [req-f7395389-430f-490c-be78-8b4e69fbe0cc req-ce61cf0e-4c22-4e43-a316-b1f138dc35aa tempest-MultipleCreateTestJSON-291625432 tempest-MultipleCreateTestJSON-291625432-project-member] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1236.262231] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1236.263358] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.263457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.580546] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-242 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.580740] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.580866] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.581164] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.581417] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.581577] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.581694] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.581958] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.582132] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.582342] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1236.582456] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1236.582597] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1236.582676] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1236.582784] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1236.582889] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1236.583035] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1236.605684] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1236.605684] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1236.605938] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1236.606062] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-242" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1236.606399] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-f0dc6ef0-5f71-4093-9507-430709a65c03 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1236.606565] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-f0dc6ef0-5f71-4093-9507-430709a65c03" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1236.606690] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-f0dc6ef0-5f71-4093-9507-430709a65c03" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1236.607082] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-f0dc6ef0-5f71-4093-9507-430709a65c03" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1236.607225] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0dc6ef0-5f71-4093-9507-430709a65c03',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1236.700710] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1237.109684] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.110854] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.110854] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.110854] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.110854] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.111705] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port f0dc6ef0-5f71-4093-9507-430709a65c03 not found, creating... [ 1237.111705] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.111705] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.111705] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.111705] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.111911] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.112099] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.112239] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.112359] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.112566] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.112701] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.112840] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: f0dc6ef0-5f71-4093-9507-430709a65c03 is going to be created. [ 1237.133327] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.133532] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.133659] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.134037] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.134277] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.134503] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-f0dc6ef0-5f71-4093-9507-430709a65c03" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.203463] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.203869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.203869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.203945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.203979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.204106] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be created. [ 1237.244544] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.244771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.244832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.245153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.245356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.272187] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: UNINITIALIZED for 2s [ 1237.860014] env[67003]: INFO networking_nsxv3.common.synchronization [req-f7395389-430f-490c-be78-8b4e69fbe0cc req-998389dc-e209-4f80-b331-0ba3babdccfb service nova] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_rules [ 1237.860245] env[67003]: INFO networking_nsxv3.common.synchronization [req-f7395389-430f-490c-be78-8b4e69fbe0cc req-998389dc-e209-4f80-b331-0ba3babdccfb service nova] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1237.860432] env[67003]: INFO networking_nsxv3.common.synchronization [req-f7395389-430f-490c-be78-8b4e69fbe0cc req-998389dc-e209-4f80-b331-0ba3babdccfb service nova] Enqueued Resource ID: f0dc6ef0-5f71-4093-9507-430709a65c03 with Priority: HIGHEST for action port [ 1237.861035] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_rules [ 1237.861271] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1237.861271] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f0dc6ef0-5f71-4093-9507-430709a65c03 with Priority: HIGHEST for action port [ 1237.861566] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.861674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.861903] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.861955] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.862145] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-f0dc6ef0-5f71-4093-9507-430709a65c03 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1237.862247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f0dc6ef0-5f71-4093-9507-430709a65c03" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1237.862309] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f0dc6ef0-5f71-4093-9507-430709a65c03" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1237.862539] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f0dc6ef0-5f71-4093-9507-430709a65c03" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1237.862629] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f0dc6ef0-5f71-4093-9507-430709a65c03',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1238.366086] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f0dc6ef0-5f71-4093-9507-430709a65c03 with status ACTIVE [ 1238.366403] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.366464] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.366535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.366742] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.366833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.367029] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.367132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.367195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.367343] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.367419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.367597] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.367690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.367753] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.367981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.368097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.368184] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f0dc6ef0-5f71-4093-9507-430709a65c03 is going to be updated. [ 1238.389299] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1238.389512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1238.389512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1238.389714] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1238.389850] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1238.390021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f0dc6ef0-5f71-4093-9507-430709a65c03" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.103024] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-873 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.103421] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.103588] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.103862] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.104155] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.104323] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.104478] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.104709] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.104895] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.105180] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1239.105339] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1239.105490] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1239.105629] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1239.105781] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1239.105896] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1239.106125] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1239.127336] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1239.127617] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1239.128181] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1239.128181] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-873" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.128500] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-d514752b-8eef-4d09-918b-0652fbf1874b taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.128726] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.128877] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.129234] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.129385] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d514752b-8eef-4d09-918b-0652fbf1874b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.283427] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: SUCCESS [ 1239.283770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.283932] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.284249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.284502] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.284669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.284747] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.284966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.285146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.285278] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.285418] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.286581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.286796] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.287407] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.287407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.287407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.287407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.287601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.287601] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.633285] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.633627] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.633669] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.633943] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.634182] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.634585] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.634777] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.634904] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.635223] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.635374] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.635703] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.635868] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.635989] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.636217] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.636363] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.636496] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: d514752b-8eef-4d09-918b-0652fbf1874b is going to be updated. [ 1239.660543] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.660770] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.661573] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.661573] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.661573] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.661732] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.791134] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.791283] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.791469] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.294675] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.360564] env[67003]: INFO networking_nsxv3.common.synchronization [req-c5688d3f-0ae4-4019-8ce4-0386c3f44fd5 req-452d76be-20ae-4a5d-82ea-4df0d6cd4825 service nova] Enqueued Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_rules [ 1240.361143] env[67003]: INFO networking_nsxv3.common.synchronization [req-c5688d3f-0ae4-4019-8ce4-0386c3f44fd5 req-452d76be-20ae-4a5d-82ea-4df0d6cd4825 service nova] Enqueued Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_members [ 1240.361143] env[67003]: INFO networking_nsxv3.common.synchronization [req-c5688d3f-0ae4-4019-8ce4-0386c3f44fd5 req-452d76be-20ae-4a5d-82ea-4df0d6cd4825 service nova] Enqueued Resource ID: d514752b-8eef-4d09-918b-0652fbf1874b with Priority: HIGHEST for action port [ 1240.361401] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_rules [ 1240.361536] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_members [ 1240.361633] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d514752b-8eef-4d09-918b-0652fbf1874b with Priority: HIGHEST for action port [ 1240.361905] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-02817089-de2d-4fa5-aa82-3c16b3cb154a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.362038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.362107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.362306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.362389] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.363219] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-02817089-de2d-4fa5-aa82-3c16b3cb154a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.363333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.363402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.363566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.363713] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.363809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.363871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.364795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.364990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.365183] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.366280] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d514752b-8eef-4d09-918b-0652fbf1874b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.366518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.366628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.366859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.366987] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d514752b-8eef-4d09-918b-0652fbf1874b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.798966] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.799350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.799350] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.799463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.799556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.799660] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be updated. [ 1240.832210] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.832392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.832457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.832715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.832868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.847459] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: IN_PROGRESS for 2s [ 1240.871146] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.872565] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-02817089-de2d-4fa5-aa82-3c16b3cb154a taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.872739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.872856] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d514752b-8eef-4d09-918b-0652fbf1874b with status ACTIVE [ 1240.873137] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.873337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.873471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.873646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.873734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.873934] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.874110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.874198] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.874414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.874496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.874756] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.874840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.874883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.875056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.875147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.875261] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d514752b-8eef-4d09-918b-0652fbf1874b is going to be updated. [ 1240.904395] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.904395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.904395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.904395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.904395] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.904783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d514752b-8eef-4d09-918b-0652fbf1874b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.258545] env[67003]: INFO networking_nsxv3.common.synchronization [req-160c1856-0a1d-4399-bcbf-754c1be2dee5 req-7cbe189c-ccee-4f8f-a2c0-a8add7baad21 tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_members [ 1241.259130] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_members [ 1241.259471] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.260308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.260308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.260308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.264288] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.264288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.264288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.264288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.264288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.264288] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.378091] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.769083] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.881701] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.882081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.882081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.882313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.882407] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.882513] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a is going to be updated. [ 1241.923745] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.923745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.923745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.923745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.923745] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.932286] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a in Status: IN_PROGRESS for 2s [ 1242.271250] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.775090] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.775090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.775090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.775090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.775090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.775090] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc is going to be updated. [ 1242.805384] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.805580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.805580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.805981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.806242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.816398] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: IN_PROGRESS for 2s [ 1242.856780] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: SUCCESS [ 1242.856988] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.857172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.857390] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.857577] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.857696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.857763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.858014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.858113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.858249] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.360898] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.863141] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1243.942649] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a in Status: SUCCESS [ 1243.942843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.943018] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.943247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.943456] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.943584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.943654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.943778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.943968] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.944213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.944356] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.365790] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.366195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.366195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.366195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.366288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.366369] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be updated. [ 1244.400618] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.400775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.400824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.401071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.401218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.410787] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: IN_PROGRESS for 2s [ 1244.446355] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.827702] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: SUCCESS [ 1244.827979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.948775] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 02817089-de2d-4fa5-aa82-3c16b3cb154a: rpc.has_security_group_logging(os_id): False [ 1244.969358] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.969638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.969705] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.969975] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.970118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.970443] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.970550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.970616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.970802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.970882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.970973] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a is going to be updated. [ 1245.064840] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.065014] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.065088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.065294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.065471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.079774] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a in Status: IN_PROGRESS for 2s [ 1246.260655] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1246.260937] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 1246.361709] env[67003]: INFO networking_nsxv3.common.synchronization [req-cccfc662-6d3f-4e13-9e77-cbce9facc19d req-1137049d-a72d-4a8a-9f7e-9e9d21cd8a50 tempest-ServerActionsTestJSON-1949922754 tempest-ServerActionsTestJSON-1949922754-project-member] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1246.362147] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1246.362468] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.363337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.363337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.363337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.363337] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.363337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.363662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.363662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.363662] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.363761] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.425232] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: SUCCESS [ 1246.425668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.426665] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.426999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.427272] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.427411] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.427643] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.427757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.427757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.427924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.431965] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.432243] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.432336] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.432569] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.433077] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.433077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.433077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.433244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.433244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.433320] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.433374] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.719408] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-36 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.719848] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.720108] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.720601] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.721106] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.721418] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.721660] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.722099] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.722375] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.722743] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.722965] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.723207] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.723429] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.723684] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.723870] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.724151] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.750474] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.750657] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1246.751574] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.751574] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-36" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.751574] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-952592bc-563c-45e4-9c48-d52ca686f8b9 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.751783] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-952592bc-563c-45e4-9c48-d52ca686f8b9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.751783] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-952592bc-563c-45e4-9c48-d52ca686f8b9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.752170] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-952592bc-563c-45e4-9c48-d52ca686f8b9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.752405] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('952592bc-563c-45e4-9c48-d52ca686f8b9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.865921] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.866143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.866213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.866421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.866579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.866804] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.866903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.866966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.867130] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.867204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.867289] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 is going to be updated. [ 1246.896777] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.897049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.897049] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.897307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.897494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.908318] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: IN_PROGRESS for 2s [ 1246.935857] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e58b8643-f9c9-4a73-8e5a-fd47e5555807: rpc.has_security_group_logging(os_id): False [ 1246.960056] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.960280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.960333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.960518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.960609] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.960936] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.961071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.961113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.961255] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.961337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.961519] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.961615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.961678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.961818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.961925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.962182] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.962281] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.962343] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.962486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.962567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.962645] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be created. [ 1247.026339] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.026490] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.026532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.026872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.027048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.042221] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: IN_PROGRESS for 2s [ 1247.101779] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a in Status: SUCCESS [ 1247.102176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.255168] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.255431] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.255504] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.255833] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.256094] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.256308] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 952592bc-563c-45e4-9c48-d52ca686f8b9 not found, creating... [ 1247.256588] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.256730] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.256854] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.257086] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.257224] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.257506] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.257646] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.257765] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.258292] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.258793] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.258885] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 952592bc-563c-45e4-9c48-d52ca686f8b9 is going to be created. [ 1247.284606] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.284606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.284606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.284606] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.285134] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.285134] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-952592bc-563c-45e4-9c48-d52ca686f8b9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.059880] env[67003]: INFO networking_nsxv3.common.synchronization [req-cccfc662-6d3f-4e13-9e77-cbce9facc19d req-d4fa2c89-3389-4df5-ab6c-a15acafe5c71 service nova] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_rules [ 1248.059880] env[67003]: INFO networking_nsxv3.common.synchronization [req-cccfc662-6d3f-4e13-9e77-cbce9facc19d req-d4fa2c89-3389-4df5-ab6c-a15acafe5c71 service nova] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1248.059880] env[67003]: INFO networking_nsxv3.common.synchronization [req-cccfc662-6d3f-4e13-9e77-cbce9facc19d req-d4fa2c89-3389-4df5-ab6c-a15acafe5c71 service nova] Enqueued Resource ID: 952592bc-563c-45e4-9c48-d52ca686f8b9 with Priority: HIGHEST for action port [ 1248.061117] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_rules [ 1248.061117] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1248.061117] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 952592bc-563c-45e4-9c48-d52ca686f8b9 with Priority: HIGHEST for action port [ 1248.061381] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.061531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.061579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.061771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.061855] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.062771] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.062872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.063096] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-952592bc-563c-45e4-9c48-d52ca686f8b9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.063200] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-952592bc-563c-45e4-9c48-d52ca686f8b9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.063265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-952592bc-563c-45e4-9c48-d52ca686f8b9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.063441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-952592bc-563c-45e4-9c48-d52ca686f8b9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.063519] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('952592bc-563c-45e4-9c48-d52ca686f8b9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.565460] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.565986] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.565986] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 952592bc-563c-45e4-9c48-d52ca686f8b9 with status ACTIVE [ 1248.565986] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.566143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.566143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.566429] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.566496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.566652] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.566751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.566813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.566978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.567068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.567330] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.567430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.567493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.567636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.567764] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.567909] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 952592bc-563c-45e4-9c48-d52ca686f8b9 is going to be updated. [ 1248.590948] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.590948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.590948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.590948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.590948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.591329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-952592bc-563c-45e4-9c48-d52ca686f8b9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.919141] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: SUCCESS [ 1248.919141] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 deletion is rescheduled due to dependency. [ 1248.919141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.919141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.919141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.919530] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.919530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.919530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.919653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.919653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.919808] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.058205] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: SUCCESS [ 1249.058467] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.059177] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.059404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.059507] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.403527] env[67003]: INFO networking_nsxv3.common.synchronization [req-7bbce4fa-12ef-4bc0-af24-61367f86ee8b req-4bdca0bd-d942-4bc4-b417-28374706ed5f tempest-MultipleCreateTestJSON-291625432 tempest-MultipleCreateTestJSON-291625432-project-member] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1249.404310] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1249.404310] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.405095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.405095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.405095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.405250] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.405299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.405331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.405506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.405571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.405727] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.422749] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.488102] env[67003]: INFO networking_nsxv3.common.synchronization [req-eba3618b-0908-430e-b1e3-9e51683e0fc4 req-001b2940-ed6d-49b6-998f-6d9e899b67eb tempest-MultipleCreateTestJSON-291625432 tempest-MultipleCreateTestJSON-291625432-project-member] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1249.488611] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGHEST for action security_group_members [ 1249.488924] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.489043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.561572] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.561712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.908902] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.928231] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.411864] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1250.430973] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.430973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.430973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.431154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.431232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.431313] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 is going to be updated. [ 1250.470487] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.470760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.470760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.470900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.471075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.480721] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: IN_PROGRESS for 2s [ 1250.914012] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.914393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.914393] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.914466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.914562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.914660] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be updated. [ 1250.945030] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.945219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.945260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.945457] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.945600] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.955453] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: IN_PROGRESS for 2s [ 1252.491611] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: SUCCESS [ 1252.491942] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.492022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.492247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.492448] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.492577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.492633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.492802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.492883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.492979] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.493094] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.967194] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: SUCCESS [ 1252.967426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.967626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.967821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.968070] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.968199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.968265] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.968432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.968519] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.968612] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.995908] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.471439] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.471605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.471678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.471891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.471985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.472189] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.472288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.472352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.472498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.472573] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.472657] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be updated. [ 1253.499162] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.499529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.499529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.499605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.499721] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.501335] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7f76d7e-ac8b-403e-8138-5cfc21622e31: rpc.has_security_group_logging(os_id): False [ 1253.511060] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: IN_PROGRESS for 2s [ 1253.528774] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.528957] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.529016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.529236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.529331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.529586] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.529690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.529756] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.529903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.529981] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.530078] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 is going to be updated. [ 1253.600345] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.600577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.600577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.600767] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.600910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.613428] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: IN_PROGRESS for 2s [ 1254.490109] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1254.490109] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1255.521444] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: SUCCESS [ 1255.521797] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 deletion is rescheduled due to dependency. [ 1255.521797] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.521963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.522154] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.522339] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1255.522530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1255.522530] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1255.522842] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1255.522842] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.522842] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.522935] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1255.625533] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: SUCCESS [ 1255.625795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.025091] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.025299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.025299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.025413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.025576] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.025678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.025743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.025904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.025978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.026079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.026223] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.026315] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.026376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.026532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.026676] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.026769] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.026829] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.026966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.027055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.027141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.027230] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.205482] env[67003]: INFO networking_nsxv3.common.synchronization [req-243ec6f2-9b01-4bb0-afa6-b3dd3f984ed5 req-46bc3da3-0511-44f8-b9a1-c483f2af066f tempest-ServerActionsTestOtherB-185944640 tempest-ServerActionsTestOtherB-185944640-project-member] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1256.206622] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1256.207033] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.207218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.207328] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.207561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.207779] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.207971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.208086] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.208286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.208419] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.208552] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.530827] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e58b8643-f9c9-4a73-8e5a-fd47e5555807: rpc.has_security_group_logging(os_id): False [ 1256.558397] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.558566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.558617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.558856] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.559406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.559563] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.559670] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.559906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.559906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.561118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.561398] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.561531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.561531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.561914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.561914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.562285] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.562285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.562285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.562285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.562445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.562445] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be updated. [ 1256.630724] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.630724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.630916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.631577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.631577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.649254] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: IN_PROGRESS for 2s [ 1256.711340] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.711519] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.711591] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.711808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.711904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.712126] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.712232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.712296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.712455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.712533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.712621] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be updated. [ 1256.745401] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.745401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.745401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.745401] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.745574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.758679] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 2s [ 1258.664727] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 in Status: SUCCESS [ 1258.664727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.768967] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 1258.768967] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e deletion is rescheduled due to dependency. [ 1258.768967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.701556] env[67003]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1260.701847] env[67003]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] NSXv3 Agent Agent loop - iteration:3 started [ 1261.207836] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1261.207836] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1262.037126] env[67003]: INFO networking_nsxv3.common.synchronization [req-dac3ee3b-7d65-4448-93d0-8ee41dcfc1ef req-2a1769aa-2236-4671-82c3-d38d7132879f tempest-ServerActionsTestOtherA-1424940452 tempest-ServerActionsTestOtherA-1424940452-project-member] Enqueued Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_members [ 1262.037654] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGHEST for action security_group_members [ 1262.038045] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.038189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.038258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.038453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.038606] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.038700] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.038762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.038944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.039043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.039163] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.541538] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.541728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.541789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.542082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.542202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.542388] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.542493] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.542558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.542713] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.543117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.543117] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc is going to be updated. [ 1262.571056] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.571228] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.571266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.571476] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.571624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.582451] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: IN_PROGRESS for 2s [ 1264.593957] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc in Status: SUCCESS [ 1264.594551] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc deletion is rescheduled due to dependency. [ 1264.594551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.809470] env[67003]: INFO networking_nsxv3.common.synchronization [req-3f755569-e67f-4a86-bf9d-6437e2403d90 req-46993412-4c00-410d-ae62-880ea6319a84 tempest-ServerActionsTestOtherB-185944640 tempest-ServerActionsTestOtherB-185944640-project-member] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1264.809470] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1264.809737] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.809857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.809926] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.810133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.810291] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1264.810387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1264.810435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1264.810578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1264.810656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1264.810749] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.111086] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.111325] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.111452] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.111713] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.112110] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.112300] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.112421] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.112636] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.112782] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.112986] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1265.113111] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1265.113220] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1265.113328] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1265.113435] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1265.113538] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1265.113664] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1265.134162] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1265.134336] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1265.134473] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1265.134650] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.135043] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-3ed6524f-fea7-480f-80ca-599dcfccabc0 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.135177] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.135292] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.135736] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.135948] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed6524f-fea7-480f-80ca-599dcfccabc0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.313144] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.313355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.313355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.313560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.313673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.313919] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.314058] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.314146] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.314391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.314474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.314545] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be updated. [ 1265.342704] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.342901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.342901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.343402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.343402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.353500] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 2s [ 1265.638440] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.638868] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.638868] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.639087] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.639248] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.639398] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 3ed6524f-fea7-480f-80ca-599dcfccabc0 not found, creating... [ 1265.639643] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.639799] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.639917] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.640184] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.640291] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.640561] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.640715] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.640831] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.641042] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.641177] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.641313] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 3ed6524f-fea7-480f-80ca-599dcfccabc0 is going to be created. [ 1265.661341] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.661645] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.661645] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.661818] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.662085] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.663482] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.367559] env[67003]: INFO networking_nsxv3.common.synchronization [req-3f755569-e67f-4a86-bf9d-6437e2403d90 req-fe5f04f9-fec8-485a-aee9-cf11db6dfa1b service nova] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_rules [ 1266.368097] env[67003]: INFO networking_nsxv3.common.synchronization [req-3f755569-e67f-4a86-bf9d-6437e2403d90 req-fe5f04f9-fec8-485a-aee9-cf11db6dfa1b service nova] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1266.368273] env[67003]: INFO networking_nsxv3.common.synchronization [req-3f755569-e67f-4a86-bf9d-6437e2403d90 req-fe5f04f9-fec8-485a-aee9-cf11db6dfa1b service nova] Enqueued Resource ID: 3ed6524f-fea7-480f-80ca-599dcfccabc0 with Priority: HIGHEST for action port [ 1266.368828] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_rules [ 1266.368937] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1266.369586] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed6524f-fea7-480f-80ca-599dcfccabc0 with Priority: HIGHEST for action port [ 1266.369923] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.370496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.370496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.370681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.370712] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.371720] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.371900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.372398] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ed6524f-fea7-480f-80ca-599dcfccabc0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.372510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.372577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.373148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.373233] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed6524f-fea7-480f-80ca-599dcfccabc0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.875232] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.875507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.877804] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ed6524f-fea7-480f-80ca-599dcfccabc0 with status ACTIVE [ 1266.877924] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.878055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.878106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.879023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.879023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.879023] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.879023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.879023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.879023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.879023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.879316] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.879316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.879316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.879476] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.879529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.879649] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ed6524f-fea7-480f-80ca-599dcfccabc0 is going to be updated. [ 1266.900866] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.901166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.901166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.901322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.901507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.901624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.364037] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 1267.364193] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e deletion is rescheduled due to dependency. [ 1267.364303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.365030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.365030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.365030] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.365030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.365030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.365286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.365286] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.365352] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.867339] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.369367] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.873967] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.874156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.874229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.874441] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.874533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.874630] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be updated. [ 1268.902469] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.902640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.902681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.902891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.903534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.913093] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 2s [ 1270.924775] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 1270.925153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.925454] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.925552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.925790] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.925971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.926079] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.926289] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.926403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.926507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.926633] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.370610] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1271.370817] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1271.429311] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.932070] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 716cf816-3048-4122-8676-0137157fed0e: rpc.has_security_group_logging(os_id): False [ 1271.951635] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.951842] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.951842] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.951995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.952101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.952345] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.952445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.952507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.952651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.952725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.952808] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be updated. [ 1272.014585] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.014792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.014792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.015059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.015214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.030978] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 2s [ 1272.646281] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.646494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.646617] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.646804] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.646916] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.148975] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.652219] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1274.045973] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 1274.045973] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.154065] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1274.154482] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1274.908953] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.909295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.909295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.909386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.922381] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1274.923386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.924397] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1274.964959] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1274.965159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1274.965232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1274.965405] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1274.979132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.979970] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1274.980085] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1274.980161] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1275.019821] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.020073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.020073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.020231] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.021782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.021782] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1275.096129] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.096341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.096381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.096568] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.096867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.097150] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1275.178639] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.178639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.178639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.178639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.178639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.178639] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:42. [ 1275.178639] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'e58b8643-f9c9-4a73-8e5a-fd47e5555807', 'e7a3c46b-3fe8-4a52-b683-e71e757f6303', '00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a', '33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a', '4cad76eb-924a-41f1-b865-f281dc96cec6', 'a73c2b37-9987-4ee9-8def-05a85741b451', '14acdd23-bebb-4c9b-ad3a-42f438a0a5eb', '06d182ef-21b7-44fd-8cbf-2f35f7927435', '993ce117-521f-4677-9ad6-2a219a7366c9', '745fb2b7-cb25-4398-b51d-8a61982bb1ed', 'f76f58af-f507-4428-b198-11ce6caf814d', '88eb58df-f15b-48e8-baa4-7b64e596d069', 'd622b8c0-157c-4b92-b9e3-c2d6c4c2793b', '62aff8a2-792c-4df1-90fb-88b44b18cc02', 'dba32874-38b5-4411-a3c9-effdd63d65c0', 'a47e002a-325f-4303-8dea-86209028ebb0', '55872268-81d2-4523-87e7-e00ce5194127', '21049d56-f228-42f2-ae78-92a23f8b3932', 'e316a4c0-3a83-4827-a5c7-8cc4a342b65d', '55815927-bbca-4dbc-be18-77001e3e9c6b', 'ea11303f-c0fb-4922-8c26-9eb29fdbf672', '00a6980b-e22e-4c0a-a83a-f2c84907f57a', '64b82baf-96b3-4d2a-a0f3-634fd5e24137', 'aa8a0a38-37aa-4674-acd4-bfc56f11a31e', '4ec9467a-c24b-4be1-ba5a-173726e27cfc', '4ca7593b-6cf9-418e-9d37-bb09b986e001', '9f930f78-bc74-4f34-9558-0ffb6faee5ec', 'a279ae9a-5f5b-4b3f-a403-fcef8683474d', '032f92e2-50d8-4e5f-901e-8c80dbcfbdf5', '25f0058d-8729-4623-a291-7d3376597063', '09ad0af4-47bb-47f8-a343-07c0b9be11a8', '879b3713-7487-492d-b6e1-77747451fce3', 'f2e25f5a-d04c-463f-a7f6-17866b02d583', '716cf816-3048-4122-8676-0137157fed0e', 'b1fb9da3-caa0-493e-935e-25393509c210', 'b0a0dd07-31c8-4f23-b815-1cf422605b14', 'd9485466-865a-4183-ac2a-0720f6740f8a', '7a631474-f774-4747-8676-6477b61cae29', 'ea05aafd-d89a-4a4a-8f6a-25194a42d3e1', 'eda6bee5-9b5c-4b6f-888f-231f9c7282b1', '02817089-de2d-4fa5-aa82-3c16b3cb154a', 'c7f76d7e-ac8b-403e-8138-5cfc21622e31'} {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1275.178639] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1275.197286] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.197527] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.197527] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.197697] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.197804] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.197936] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1275.198028] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1275.198141] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1275.275720] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1275.275937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1275.275937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1275.276156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1275.277235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.277486] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1275.277565] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1275.277634] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1275.277702] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1275.277798] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/42 resources of Type:Security Group Rules [ 1275.277858] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGH for action security_group_rules [ 1275.277928] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGH for action security_group_rules [ 1275.277995] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGH for action security_group_rules [ 1275.278212] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGH for action security_group_rules [ 1275.278349] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGH for action security_group_rules [ 1275.278438] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGH for action security_group_rules [ 1275.278533] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb with Priority: HIGH for action security_group_rules [ 1275.278604] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGH for action security_group_rules [ 1275.278670] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGH for action security_group_rules [ 1275.278735] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGH for action security_group_rules [ 1275.278817] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGH for action security_group_rules [ 1275.278892] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGH for action security_group_rules [ 1275.278973] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGH for action security_group_rules [ 1275.279088] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGH for action security_group_rules [ 1275.279192] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dba32874-38b5-4411-a3c9-effdd63d65c0 with Priority: HIGH for action security_group_rules [ 1275.279264] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGH for action security_group_rules [ 1275.279327] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGH for action security_group_rules [ 1275.279390] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 21049d56-f228-42f2-ae78-92a23f8b3932 with Priority: HIGH for action security_group_rules [ 1275.279472] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGH for action security_group_rules [ 1275.279538] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGH for action security_group_rules [ 1275.279651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.372466] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1276.373082] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1276.373082] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 with Priority: HIGH for action security_group_rules [ 1276.373082] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a with Priority: HIGH for action security_group_rules [ 1276.373082] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb with Priority: HIGH for action security_group_rules [ 1276.373280] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dba32874-38b5-4411-a3c9-effdd63d65c0 with Priority: HIGH for action security_group_rules [ 1276.374090] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55815927-bbca-4dbc-be18-77001e3e9c6b with Priority: HIGH for action security_group_rules [ 1276.374356] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d with Priority: HIGH for action security_group_rules [ 1276.374356] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21049d56-f228-42f2-ae78-92a23f8b3932 with Priority: HIGH for action security_group_rules [ 1276.374356] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 55872268-81d2-4523-87e7-e00ce5194127 with Priority: HIGH for action security_group_rules [ 1276.374532] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 with Priority: HIGH for action security_group_rules [ 1276.374564] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a47e002a-325f-4303-8dea-86209028ebb0 with Priority: HIGH for action security_group_rules [ 1276.374639] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b with Priority: HIGH for action security_group_rules [ 1276.374727] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 with Priority: HIGH for action security_group_rules [ 1276.374825] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f76f58af-f507-4428-b198-11ce6caf814d with Priority: HIGH for action security_group_rules [ 1276.374917] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed with Priority: HIGH for action security_group_rules [ 1276.375016] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 993ce117-521f-4677-9ad6-2a219a7366c9 with Priority: HIGH for action security_group_rules [ 1276.375112] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGH for action security_group_rules [ 1276.375215] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 with Priority: HIGH for action security_group_rules [ 1276.375304] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 with Priority: HIGH for action security_group_rules [ 1276.375389] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 with Priority: HIGH for action security_group_rules [ 1276.375475] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a with Priority: HIGH for action security_group_rules [ 1276.375857] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.376043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.376127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.376355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.376441] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e58b8643-f9c9-4a73-8e5a-fd47e5555807',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.377516] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.377642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.377684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.377875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.377953] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.378897] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.379055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.379055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.379239] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.379383] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14acdd23-bebb-4c9b-ad3a-42f438a0a5eb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.380129] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dba32874-38b5-4411-a3c9-effdd63d65c0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.380259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.380259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.380391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.380463] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dba32874-38b5-4411-a3c9-effdd63d65c0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.381365] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55815927-bbca-4dbc-be18-77001e3e9c6b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.381471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.381618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.381678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.381735] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55815927-bbca-4dbc-be18-77001e3e9c6b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.382688] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.382688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.382688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.382875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.382875] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e316a4c0-3a83-4827-a5c7-8cc4a342b65d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.383533] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-21049d56-f228-42f2-ae78-92a23f8b3932 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.383651] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.383693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.383869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.383995] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('21049d56-f228-42f2-ae78-92a23f8b3932',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.384612] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-55872268-81d2-4523-87e7-e00ce5194127 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.384714] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.384778] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.384945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.385030] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('55872268-81d2-4523-87e7-e00ce5194127',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.385842] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62aff8a2-792c-4df1-90fb-88b44b18cc02 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.385945] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.386022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.386170] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.386243] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62aff8a2-792c-4df1-90fb-88b44b18cc02',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.386958] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a47e002a-325f-4303-8dea-86209028ebb0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.387068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.387116] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.387250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.387338] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a47e002a-325f-4303-8dea-86209028ebb0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.388110] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.388202] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.388268] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.388416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.388493] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d622b8c0-157c-4b92-b9e3-c2d6c4c2793b',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.389329] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-88eb58df-f15b-48e8-baa4-7b64e596d069 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.389461] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.389527] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.389673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.389762] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('88eb58df-f15b-48e8-baa4-7b64e596d069',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.390500] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f76f58af-f507-4428-b198-11ce6caf814d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.390649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.390717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.390868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.390961] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f76f58af-f507-4428-b198-11ce6caf814d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.391716] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.391822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.391900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.392070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.392183] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('745fb2b7-cb25-4398-b51d-8a61982bb1ed',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.392892] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-993ce117-521f-4677-9ad6-2a219a7366c9 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.393025] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.393096] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.393296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.393338] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('993ce117-521f-4677-9ad6-2a219a7366c9',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.394185] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a73c2b37-9987-4ee9-8def-05a85741b451 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.394329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.394400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.394551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.394642] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.395462] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-06d182ef-21b7-44fd-8cbf-2f35f7927435 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.395577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.395642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.395815] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.395889] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('06d182ef-21b7-44fd-8cbf-2f35f7927435',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.396652] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4cad76eb-924a-41f1-b865-f281dc96cec6 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.396763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.396835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.397576] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.397576] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4cad76eb-924a-41f1-b865-f281dc96cec6',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.397816] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.399721] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.399829] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.400757] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.400757] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e7a3c46b-3fe8-4a52-b683-e71e757f6303',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.400896] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.401020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.401127] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.401725] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.401956] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.431105] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.431326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.431837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.431837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.448343] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.448525] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.449717] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.449820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.454848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.454967] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55815927-bbca-4dbc-be18-77001e3e9c6b is going to be deleted. [ 1276.455862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.456101] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.511300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.511482] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e316a4c0-3a83-4827-a5c7-8cc4a342b65d is going to be deleted. [ 1276.512671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.513129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.541298] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.541486] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a is going to be deleted. [ 1276.557718] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.557906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.557953] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.558511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.558511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.558511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55815927-bbca-4dbc-be18-77001e3e9c6b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.564498] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.564845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.564959] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.565196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.565288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.565409] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e316a4c0-3a83-4827-a5c7-8cc4a342b65d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.604912] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.605123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.605123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.605337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.605427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.605549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b2f282-e2e7-42d1-b6a6-5aab1ac3ff2a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.916279] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a73c2b37-9987-4ee9-8def-05a85741b451 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.917039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.917039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.917039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.917039] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.917285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.917285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.917351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.917410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.917496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1276.917583] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1276.949585] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.950280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.950280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1276.950280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1276.955309] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.955464] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.956208] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.956321] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.984223] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.984476] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.988601] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.988772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.989590] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.989696] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.990436] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.990537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.991252] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.991347] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.992102] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.992203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.992961] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.993069] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.993812] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.993901] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.994496] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1276.994965] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.995081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.995754] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1276.996261] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.996399] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.996990] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1276.997444] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.997543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.998265] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1276.998739] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1276.998833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1276.999520] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1276.999913] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.000021] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.000636] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1277.001043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.001150] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dba32874-38b5-4411-a3c9-effdd63d65c0 is going to be deleted. [ 1277.002166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.002376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.020428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.020586] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d622b8c0-157c-4b92-b9e3-c2d6c4c2793b is going to be deleted. [ 1277.021430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.021638] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.042024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.042196] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e58b8643-f9c9-4a73-8e5a-fd47e5555807 is going to be deleted. [ 1277.043082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.043311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.070147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.070338] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e7a3c46b-3fe8-4a52-b683-e71e757f6303 is going to be deleted. [ 1277.071257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.071472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.084092] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.084307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.085776] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.085883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.092209] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.092337] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62aff8a2-792c-4df1-90fb-88b44b18cc02 is going to be deleted. [ 1277.093238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.093456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.113372] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.113572] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.114513] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.114628] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 06d182ef-21b7-44fd-8cbf-2f35f7927435 is going to be deleted. [ 1277.115512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.115728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.157400] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.157628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.172170] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.172317] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 55872268-81d2-4523-87e7-e00ce5194127 is going to be deleted. [ 1277.173199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.173416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.219724] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.219929] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.225711] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.225854] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4cad76eb-924a-41f1-b865-f281dc96cec6 is going to be deleted. [ 1277.226733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.226950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.230061] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.230175] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.259201] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.259374] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 88eb58df-f15b-48e8-baa4-7b64e596d069 is going to be deleted. [ 1277.260335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.260562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.290297] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.290578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.300546] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.300694] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 745fb2b7-cb25-4398-b51d-8a61982bb1ed is going to be deleted. [ 1277.301605] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.301822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.360263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.360446] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a47e002a-325f-4303-8dea-86209028ebb0 is going to be deleted. [ 1277.361314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.361538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.377839] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.378263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.426948] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1277.434444] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.434444] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f76f58af-f507-4428-b198-11ce6caf814d is going to be deleted. [ 1277.435428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.435657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.508203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.508413] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 21049d56-f228-42f2-ae78-92a23f8b3932 is going to be deleted. [ 1277.509349] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.509569] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.519015] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.519220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.520456] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.520552] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.525704] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.525811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.568313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.568544] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14acdd23-bebb-4c9b-ad3a-42f438a0a5eb is going to be deleted. [ 1277.569933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.570178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.603226] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.603437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.604498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.604671] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 993ce117-521f-4677-9ad6-2a219a7366c9 is going to be deleted. [ 1277.605825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.606102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.673544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.673719] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a is going to be deleted. [ 1277.674654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.674870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.674962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.675094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dba32874-38b5-4411-a3c9-effdd63d65c0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.675297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.675494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.675569] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.675686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d622b8c0-157c-4b92-b9e3-c2d6c4c2793b" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.676272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.676436] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.676541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.676660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e58b8643-f9c9-4a73-8e5a-fd47e5555807" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.676828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.677020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.677071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.677197] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e7a3c46b-3fe8-4a52-b683-e71e757f6303" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.677338] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.677481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.677557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.677668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62aff8a2-792c-4df1-90fb-88b44b18cc02" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.677792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.677934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.678141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.678270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-06d182ef-21b7-44fd-8cbf-2f35f7927435" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.678427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.678578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.678656] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.678765] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-55872268-81d2-4523-87e7-e00ce5194127" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.678890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.679043] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.679141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.679263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4cad76eb-924a-41f1-b865-f281dc96cec6" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.679390] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.679533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.679606] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.679723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-88eb58df-f15b-48e8-baa4-7b64e596d069" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.679847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.679985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.680070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.680185] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-745fb2b7-cb25-4398-b51d-8a61982bb1ed" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.680312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.680481] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.680560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.680674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a47e002a-325f-4303-8dea-86209028ebb0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.680801] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.680940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.681024] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.681132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f76f58af-f507-4428-b198-11ce6caf814d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.718578] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.718772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.718772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.718998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.719106] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.719227] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-21049d56-f228-42f2-ae78-92a23f8b3932" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.753821] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.754053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.754053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.754300] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.754394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.754517] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14acdd23-bebb-4c9b-ad3a-42f438a0a5eb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.827104] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.827308] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.827355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.827562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.827652] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.827770] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-33c1a532-d2d3-4e31-a4c6-f9d53cadaf0a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.831269] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.831425] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.831465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.831657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1277.831744] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.831864] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-993ce117-521f-4677-9ad6-2a219a7366c9" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1277.929795] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a73c2b37-9987-4ee9-8def-05a85741b451: rpc.has_security_group_logging(os_id): False [ 1277.986837] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1277.987094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1277.987094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1277.987281] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.020074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.020434] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.020571] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.020640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.020848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.020934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.021048] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a73c2b37-9987-4ee9-8def-05a85741b451 is going to be updated. [ 1278.083913] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1278.084159] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1278.084208] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1278.084455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1278.084641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.099534] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a73c2b37-9987-4ee9-8def-05a85741b451 in Status: IN_PROGRESS for 2s [ 1280.115718] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a73c2b37-9987-4ee9-8def-05a85741b451 in Status: SUCCESS [ 1280.116133] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.376403] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1281.376793] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1286.378381] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1286.378381] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1291.379482] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1291.379482] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1293.216368] env[67003]: INFO networking_nsxv3.common.synchronization [req-75b98bda-5f46-4a34-88fd-020a9e10dbbb req-0b4e9f14-6dae-4aca-8505-2c24ec4ff53e tempest-AttachVolumeShelveTestJSON-97641738 tempest-AttachVolumeShelveTestJSON-97641738-project-member] Enqueued Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_members [ 1293.216910] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a with Priority: HIGHEST for action security_group_members [ 1293.217559] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-02817089-de2d-4fa5-aa82-3c16b3cb154a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.217654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.217724] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.217917] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.218107] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.218230] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.218299] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.218455] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.218562] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.218653] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('02817089-de2d-4fa5-aa82-3c16b3cb154a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.721528] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.721528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.721528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.721528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.744819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.745043] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.745169] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.745236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.745425] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.745494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.745588] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a is going to be updated. [ 1293.790694] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.790919] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.791016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.791259] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.791694] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.806580] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a in Status: IN_PROGRESS for 2s [ 1295.817990] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a in Status: SUCCESS [ 1295.818385] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 02817089-de2d-4fa5-aa82-3c16b3cb154a deletion is rescheduled due to dependency. [ 1295.818385] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-02817089-de2d-4fa5-aa82-3c16b3cb154a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.217836] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.218234] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1303.219381] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.219675] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1305.704458] env[67003]: INFO networking_nsxv3.common.synchronization [None req-324f83e9-3461-421f-a0c7-e96f92d9797a None None] Enqueued Resource ID: dcd290d0-c6bf-48d1-b289-d4ac083683e1 with Priority: HIGHEST for action port [ 1305.705187] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcd290d0-c6bf-48d1-b289-d4ac083683e1 with Priority: HIGHEST for action port [ 1305.705597] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcd290d0-c6bf-48d1-b289-d4ac083683e1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.705808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcd290d0-c6bf-48d1-b289-d4ac083683e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.705944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcd290d0-c6bf-48d1-b289-d4ac083683e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.706532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcd290d0-c6bf-48d1-b289-d4ac083683e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.706636] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcd290d0-c6bf-48d1-b289-d4ac083683e1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.153859] env[67003]: INFO networking_nsxv3.common.synchronization [None req-dad3434f-6476-4e58-b631-afd1f64b96b7 tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGHEST for action security_group_rules [ 1306.153859] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGHEST for action security_group_rules [ 1306.153859] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9de4d310-6651-400a-a748-13441816153c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.153859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.153859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.153859] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.153859] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9de4d310-6651-400a-a748-13441816153c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1306.209013] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dcd290d0-c6bf-48d1-b289-d4ac083683e1 [ 1306.209341] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.209547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.209672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.209920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.210376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.210376] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dcd290d0-c6bf-48d1-b289-d4ac083683e1 already deleted. [ 1306.210376] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcd290d0-c6bf-48d1-b289-d4ac083683e1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.239605] env[67003]: INFO networking_nsxv3.common.synchronization [None req-0f3c6ad7-1e53-4859-be73-d40ef373d955 tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGHEST for action security_group_rules [ 1306.240384] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGHEST for action security_group_rules [ 1306.240548] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9de4d310-6651-400a-a748-13441816153c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.240812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.675613] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1306.675826] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1306.675903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.676125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.676296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.676390] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9de4d310-6651-400a-a748-13441816153c already deleted. [ 1306.676470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.676633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1306.676789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1306.676873] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9de4d310-6651-400a-a748-13441816153c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1307.197274] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.197639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.197639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.197723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.197835] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.197889] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9de4d310-6651-400a-a748-13441816153c already deleted. [ 1307.197951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.690904] env[67003]: INFO networking_nsxv3.common.synchronization [None req-fbbfaf62-98da-4bf6-b60d-c7fb954d9b09 None None] Enqueued Resource ID: 91d1ab4e-e982-4e32-be3e-7ae6a3dcb2ac with Priority: HIGHEST for action port [ 1307.691510] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 91d1ab4e-e982-4e32-be3e-7ae6a3dcb2ac with Priority: HIGHEST for action port [ 1307.691865] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-91d1ab4e-e982-4e32-be3e-7ae6a3dcb2ac taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1307.691988] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-91d1ab4e-e982-4e32-be3e-7ae6a3dcb2ac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1307.692196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-91d1ab4e-e982-4e32-be3e-7ae6a3dcb2ac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1307.692478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-91d1ab4e-e982-4e32-be3e-7ae6a3dcb2ac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1307.692569] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('91d1ab4e-e982-4e32-be3e-7ae6a3dcb2ac',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1308.196415] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 91d1ab4e-e982-4e32-be3e-7ae6a3dcb2ac [ 1308.196655] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1308.196775] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1308.196847] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1308.197077] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1308.197167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1308.197263] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:91d1ab4e-e982-4e32-be3e-7ae6a3dcb2ac already deleted. [ 1308.197610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-91d1ab4e-e982-4e32-be3e-7ae6a3dcb2ac" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.137032] env[67003]: INFO networking_nsxv3.common.synchronization [req-32e09a2e-39b2-4992-82f8-03b0ec594f9f req-a8037720-98f6-4fca-a0a9-64a4dc043d3f tempest-ServerActionsTestJSON-1949922754 tempest-ServerActionsTestJSON-1949922754-project-member] Enqueued Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1309.137561] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 with Priority: HIGHEST for action security_group_members [ 1309.137865] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7f76d7e-ac8b-403e-8138-5cfc21622e31 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.137980] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.138068] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.138260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.138495] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.138607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.138676] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.138805] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.138887] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.138976] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7f76d7e-ac8b-403e-8138-5cfc21622e31',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.641251] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.641641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.641641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.641710] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.663270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.663546] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.663670] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.663736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.663933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.664026] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.664118] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 is going to be updated. [ 1309.691606] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.691827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.691827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.692036] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.692182] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.703101] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: IN_PROGRESS for 2s [ 1311.167855] env[67003]: INFO networking_nsxv3.common.synchronization [req-41f10a7c-c9e5-4434-bdd2-283ad30a88c5 req-7210e860-78ec-4973-864e-3ccacf77b96e tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGHEST for action security_group_members [ 1311.168446] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGHEST for action security_group_members [ 1311.168749] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-9de4d310-6651-400a-a748-13441816153c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.168869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.168933] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.169569] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.169762] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.170055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.170055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.170189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.170322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.170475] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9de4d310-6651-400a-a748-13441816153c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.478684] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.479049] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.479290] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.479876] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.480200] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.480466] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.480691] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.481060] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.481307] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.481629] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1311.481814] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1311.482008] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1311.482206] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1311.482393] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1311.482563] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1311.482805] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1311.505288] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1311.505467] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1311.505610] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1311.505802] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.506118] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-a81326b6-421a-4ca6-8007-a42a7ec1f8d4 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.506335] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-a81326b6-421a-4ca6-8007-a42a7ec1f8d4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.506459] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-a81326b6-421a-4ca6-8007-a42a7ec1f8d4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.506780] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-a81326b6-421a-4ca6-8007-a42a7ec1f8d4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.506921] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a81326b6-421a-4ca6-8007-a42a7ec1f8d4',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1311.672577] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.672799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.672799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.673055] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.673158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.673365] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1311.673484] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1311.673544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1311.673712] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1311.673789] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.673872] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9de4d310-6651-400a-a748-13441816153c already deleted. [ 1311.673951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1311.713459] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 in Status: SUCCESS [ 1311.713725] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7f76d7e-ac8b-403e-8138-5cfc21622e31 deletion is rescheduled due to dependency. [ 1311.713836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7f76d7e-ac8b-403e-8138-5cfc21622e31" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.009182] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.009446] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.009654] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.010054] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.010268] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.010502] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port a81326b6-421a-4ca6-8007-a42a7ec1f8d4 not found, creating... [ 1312.010863] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.011107] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.012325] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.012325] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.012325] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.012325] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.012325] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.012325] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.012596] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.012690] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.012857] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: a81326b6-421a-4ca6-8007-a42a7ec1f8d4 is going to be created. [ 1312.034866] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.035156] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.035291] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.035747] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.036010] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.036263] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-a81326b6-421a-4ca6-8007-a42a7ec1f8d4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.734736] env[67003]: INFO networking_nsxv3.common.synchronization [req-41f10a7c-c9e5-4434-bdd2-283ad30a88c5 req-c1142664-c5e4-45d9-9e85-e0c92fdeaac9 service nova] Enqueued Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGHEST for action security_group_rules [ 1312.735035] env[67003]: INFO networking_nsxv3.common.synchronization [req-41f10a7c-c9e5-4434-bdd2-283ad30a88c5 req-c1142664-c5e4-45d9-9e85-e0c92fdeaac9 service nova] Enqueued Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGHEST for action security_group_members [ 1312.735035] env[67003]: INFO networking_nsxv3.common.synchronization [req-41f10a7c-c9e5-4434-bdd2-283ad30a88c5 req-c1142664-c5e4-45d9-9e85-e0c92fdeaac9 service nova] Enqueued Resource ID: a81326b6-421a-4ca6-8007-a42a7ec1f8d4 with Priority: HIGHEST for action port [ 1312.735554] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGHEST for action security_group_rules [ 1312.735696] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGHEST for action security_group_members [ 1312.735774] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a81326b6-421a-4ca6-8007-a42a7ec1f8d4 with Priority: HIGHEST for action port [ 1312.736187] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9de4d310-6651-400a-a748-13441816153c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.736787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.736868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.737114] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.737200] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9de4d310-6651-400a-a748-13441816153c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.738409] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-9de4d310-6651-400a-a748-13441816153c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.738564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.738564] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.738783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.738944] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.739044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.739107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.739247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.739334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.739445] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9de4d310-6651-400a-a748-13441816153c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.740380] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-a81326b6-421a-4ca6-8007-a42a7ec1f8d4 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.740501] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a81326b6-421a-4ca6-8007-a42a7ec1f8d4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.740840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a81326b6-421a-4ca6-8007-a42a7ec1f8d4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.740840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a81326b6-421a-4ca6-8007-a42a7ec1f8d4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.740840] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a81326b6-421a-4ca6-8007-a42a7ec1f8d4',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.242891] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-9de4d310-6651-400a-a748-13441816153c taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.243042] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.243243] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9de4d310-6651-400a-a748-13441816153c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1313.244601] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a81326b6-421a-4ca6-8007-a42a7ec1f8d4 with status ACTIVE [ 1313.244601] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.244601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.244601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.244804] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.244804] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.244957] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.245050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.245111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.245263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.245383] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.245521] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.245608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.245664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.245802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.245875] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.245958] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a81326b6-421a-4ca6-8007-a42a7ec1f8d4 is going to be updated. [ 1313.267856] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.268081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.268081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.268271] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.268477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.268634] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a81326b6-421a-4ca6-8007-a42a7ec1f8d4" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.748676] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9de4d310-6651-400a-a748-13441816153c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.251629] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.251811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.251857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.252122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.252325] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.252325] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9de4d310-6651-400a-a748-13441816153c is going to be created. [ 1314.280782] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.280994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.280994] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.281221] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.281390] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.290223] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9de4d310-6651-400a-a748-13441816153c in Status: UNINITIALIZED for 2s [ 1316.303196] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9de4d310-6651-400a-a748-13441816153c in Status: SUCCESS [ 1316.303644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.303721] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.303951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.304164] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1316.304275] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1316.304344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1316.304516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1316.304583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.304755] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.304848] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9de4d310-6651-400a-a748-13441816153c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1316.806975] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9de4d310-6651-400a-a748-13441816153c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.309671] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9de4d310-6651-400a-a748-13441816153c: rpc.has_security_group_logging(os_id): False [ 1317.326475] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.326676] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.326676] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.326856] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.326943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.327196] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.327296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.327359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.327506] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.327582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.327671] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9de4d310-6651-400a-a748-13441816153c is going to be created. [ 1317.388648] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.388867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.388867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.389022] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.389256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.399454] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9de4d310-6651-400a-a748-13441816153c in Status: IN_PROGRESS for 2s [ 1317.737338] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1317.737607] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1319.413701] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9de4d310-6651-400a-a748-13441816153c in Status: SUCCESS [ 1319.414102] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.738724] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1322.739151] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1325.725413] env[67003]: INFO networking_nsxv3.common.synchronization [req-a249d789-a4eb-476a-99e7-e14268363959 req-83251e40-490e-4771-b783-837b63c1e688 tempest-AttachVolumeTestJSON-424960992 tempest-AttachVolumeTestJSON-424960992-project-member] Enqueued Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGHEST for action security_group_members [ 1325.725654] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGHEST for action security_group_members [ 1325.725965] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-a73c2b37-9987-4ee9-8def-05a85741b451 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.726191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.726295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.726537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.726803] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.727149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.727248] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.727442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.727560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.727702] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.232318] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.232555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.232555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.232702] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.232803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.232995] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.233110] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.233172] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.233319] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.233392] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.233478] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a73c2b37-9987-4ee9-8def-05a85741b451 is going to be updated. [ 1326.266163] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.266387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.266463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.266717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.266881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.276649] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a73c2b37-9987-4ee9-8def-05a85741b451 in Status: IN_PROGRESS for 2s [ 1328.288151] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a73c2b37-9987-4ee9-8def-05a85741b451 in Status: SUCCESS [ 1328.288495] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a73c2b37-9987-4ee9-8def-05a85741b451 deletion is rescheduled due to dependency. [ 1328.288495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1330.727493] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1330.727766] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1330.837857] env[67003]: INFO networking_nsxv3.common.synchronization [None req-18c71eab-3424-4d50-9b43-59d6d7341a57 tempest-AttachVolumeTestJSON-424960992 tempest-AttachVolumeTestJSON-424960992-project-member] Enqueued Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGHEST for action security_group_rules [ 1330.838564] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGHEST for action security_group_rules [ 1330.838786] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4336904f-d492-483f-88a0-a3b4b1515dfb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.838910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1330.838977] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1330.839244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1330.839327] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4336904f-d492-483f-88a0-a3b4b1515dfb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1330.918341] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ae799bc3-a732-47e0-8b67-a20c6d372da0 tempest-AttachVolumeTestJSON-424960992 tempest-AttachVolumeTestJSON-424960992-project-member] Enqueued Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGHEST for action security_group_rules [ 1330.918901] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGHEST for action security_group_rules [ 1330.919226] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4336904f-d492-483f-88a0-a3b4b1515dfb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1330.919330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.360381] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.360607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.360607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.360845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.360998] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.361128] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4336904f-d492-483f-88a0-a3b4b1515dfb already deleted. [ 1331.361235] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.361413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.361623] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.361733] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4336904f-d492-483f-88a0-a3b4b1515dfb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1331.881730] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1331.882134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1331.882134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1331.882216] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1331.882264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1331.882363] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4336904f-d492-483f-88a0-a3b4b1515dfb already deleted. [ 1331.882443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.920334] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1335.920734] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1337.300056] env[67003]: INFO networking_nsxv3.common.synchronization [None req-561af115-1119-4330-83ca-ff4040385ed6 None None] Enqueued Resource ID: d3ff410d-56b9-449e-b34e-32732f37c9d0 with Priority: HIGHEST for action port [ 1337.300717] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3ff410d-56b9-449e-b34e-32732f37c9d0 with Priority: HIGHEST for action port [ 1337.301335] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-d3ff410d-56b9-449e-b34e-32732f37c9d0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.301335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d3ff410d-56b9-449e-b34e-32732f37c9d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.301335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d3ff410d-56b9-449e-b34e-32732f37c9d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.301894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d3ff410d-56b9-449e-b34e-32732f37c9d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.301894] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d3ff410d-56b9-449e-b34e-32732f37c9d0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.642502] env[67003]: INFO networking_nsxv3.common.synchronization [req-f2de4cc6-1429-47bf-bf09-ca1bc79c6d3f req-075e2e9c-f227-41d6-a6aa-cb6a05885bf4 tempest-AttachVolumeTestJSON-424960992 tempest-AttachVolumeTestJSON-424960992-project-member] Enqueued Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGHEST for action security_group_members [ 1337.643086] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGHEST for action security_group_members [ 1337.643601] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4336904f-d492-483f-88a0-a3b4b1515dfb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.643601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.643601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.643831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.644015] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.644466] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.644572] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.644762] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.644852] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.644948] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4336904f-d492-483f-88a0-a3b4b1515dfb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.804144] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d3ff410d-56b9-449e-b34e-32732f37c9d0 [ 1337.804217] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.804341] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.804937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.804937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.804937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.804937] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d3ff410d-56b9-449e-b34e-32732f37c9d0 already deleted. [ 1337.804937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d3ff410d-56b9-449e-b34e-32732f37c9d0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.989541] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-920 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.989786] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-920" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.989912] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-920" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.990207] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-920" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.990474] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.990630] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.990747] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.990961] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.991126] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.991348] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1337.991458] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1337.991564] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1337.991672] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1337.991778] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1337.991882] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1337.992024] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1338.013516] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1338.013694] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1338.013859] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1338.014063] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-920" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.014474] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-1c2bcd6a-b01e-426a-88d9-9e8b1a479335 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.014667] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-1c2bcd6a-b01e-426a-88d9-9e8b1a479335" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.014801] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-1c2bcd6a-b01e-426a-88d9-9e8b1a479335" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.015142] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-1c2bcd6a-b01e-426a-88d9-9e8b1a479335" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.015296] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c2bcd6a-b01e-426a-88d9-9e8b1a479335',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.150056] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.150056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.150056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.150056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.150056] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.150367] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.150367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.150367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.150473] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.150502] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.150590] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4336904f-d492-483f-88a0-a3b4b1515dfb already deleted. [ 1338.150671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.517545] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.517845] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.517900] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.518187] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.518335] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.518519] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 1c2bcd6a-b01e-426a-88d9-9e8b1a479335 not found, creating... [ 1338.518769] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.518932] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.519063] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.519279] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.519424] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.519725] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.519884] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.519999] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.520218] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.520349] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.520489] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 1c2bcd6a-b01e-426a-88d9-9e8b1a479335 is going to be created. [ 1338.540365] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.540588] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.540725] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.540977] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.541214] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.541445] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-1c2bcd6a-b01e-426a-88d9-9e8b1a479335" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.094522] env[67003]: INFO networking_nsxv3.common.synchronization [None req-e35ece63-60bf-4cd6-8ff2-5b3fee2f7b68 None None] Enqueued Resource ID: adf705b4-7eaa-4c36-a4b0-589254965cdb with Priority: HIGHEST for action port [ 1339.095027] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adf705b4-7eaa-4c36-a4b0-589254965cdb with Priority: HIGHEST for action port [ 1339.095376] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-adf705b4-7eaa-4c36-a4b0-589254965cdb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.095507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adf705b4-7eaa-4c36-a4b0-589254965cdb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.095581] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adf705b4-7eaa-4c36-a4b0-589254965cdb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.095830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adf705b4-7eaa-4c36-a4b0-589254965cdb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.095917] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adf705b4-7eaa-4c36-a4b0-589254965cdb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.232194] env[67003]: INFO networking_nsxv3.common.synchronization [req-f2de4cc6-1429-47bf-bf09-ca1bc79c6d3f req-c534c2ac-a75a-4404-b6f5-46f1f8a1f3db service nova] Enqueued Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGHEST for action security_group_rules [ 1339.232380] env[67003]: INFO networking_nsxv3.common.synchronization [req-f2de4cc6-1429-47bf-bf09-ca1bc79c6d3f req-c534c2ac-a75a-4404-b6f5-46f1f8a1f3db service nova] Enqueued Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGHEST for action security_group_members [ 1339.232519] env[67003]: INFO networking_nsxv3.common.synchronization [req-f2de4cc6-1429-47bf-bf09-ca1bc79c6d3f req-c534c2ac-a75a-4404-b6f5-46f1f8a1f3db service nova] Enqueued Resource ID: 1c2bcd6a-b01e-426a-88d9-9e8b1a479335 with Priority: HIGHEST for action port [ 1339.232766] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGHEST for action security_group_rules [ 1339.232891] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGHEST for action security_group_members [ 1339.232988] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c2bcd6a-b01e-426a-88d9-9e8b1a479335 with Priority: HIGHEST for action port [ 1339.233637] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4336904f-d492-483f-88a0-a3b4b1515dfb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.233781] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.233821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.234023] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.234130] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4336904f-d492-483f-88a0-a3b4b1515dfb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.235180] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4336904f-d492-483f-88a0-a3b4b1515dfb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.235428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.235428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.235599] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.235751] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.235849] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.235912] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.236067] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.236153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.236243] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4336904f-d492-483f-88a0-a3b4b1515dfb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.237080] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-1c2bcd6a-b01e-426a-88d9-9e8b1a479335 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.237186] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1c2bcd6a-b01e-426a-88d9-9e8b1a479335" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.237280] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1c2bcd6a-b01e-426a-88d9-9e8b1a479335" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.237394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1c2bcd6a-b01e-426a-88d9-9e8b1a479335" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.237467] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1c2bcd6a-b01e-426a-88d9-9e8b1a479335',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.598623] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port adf705b4-7eaa-4c36-a4b0-589254965cdb [ 1339.598623] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.598623] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.598623] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.599085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.599085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.599085] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:adf705b4-7eaa-4c36-a4b0-589254965cdb already deleted. [ 1339.599085] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adf705b4-7eaa-4c36-a4b0-589254965cdb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.738703] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4336904f-d492-483f-88a0-a3b4b1515dfb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1339.739831] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4336904f-d492-483f-88a0-a3b4b1515dfb taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.739943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.740138] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1c2bcd6a-b01e-426a-88d9-9e8b1a479335 with status ACTIVE [ 1339.740298] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.740432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.740470] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.740680] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.740777] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.740942] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.741052] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.741279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.741279] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.741363] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.741509] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.741618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.741660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.741799] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.741874] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.741999] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1c2bcd6a-b01e-426a-88d9-9e8b1a479335 is going to be updated. [ 1339.762981] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1339.763215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1339.763215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1339.763351] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1339.763521] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1339.763714] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1c2bcd6a-b01e-426a-88d9-9e8b1a479335" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.243751] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4336904f-d492-483f-88a0-a3b4b1515dfb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.296631] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-441 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.296842] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.296967] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.297350] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.297614] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.297828] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.297953] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.298182] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.298322] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.298617] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1340.298788] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1340.298907] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1340.299027] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1340.299145] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1340.299251] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1340.299460] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1340.322033] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1340.322190] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1340.322311] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1340.322482] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-441" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.322795] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-3ed6524f-fea7-480f-80ca-599dcfccabc0 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.322963] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.323097] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.323353] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.323488] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed6524f-fea7-480f-80ca-599dcfccabc0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1340.747287] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.747658] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.747704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.747897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.748009] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.748110] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4336904f-d492-483f-88a0-a3b4b1515dfb is going to be created. [ 1340.772574] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.772728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.772803] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.773095] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.773272] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.782373] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4336904f-d492-483f-88a0-a3b4b1515dfb in Status: UNINITIALIZED for 2s [ 1340.825679] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.825937] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.826064] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.826362] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.826616] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.826920] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.827094] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.827215] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.827439] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.827580] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.827856] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.828023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.828145] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.828351] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.828485] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.828705] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 3ed6524f-fea7-480f-80ca-599dcfccabc0 is going to be updated. [ 1340.849139] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1340.849361] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1340.849459] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1340.849739] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1340.849941] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1340.850174] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.554043] env[67003]: INFO networking_nsxv3.common.synchronization [req-215d1d9c-a085-401b-a4a2-ae9486c3919c req-5c56b3c2-d70e-48fb-a26b-8b8a7fcdac28 service nova] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_rules [ 1341.554593] env[67003]: INFO networking_nsxv3.common.synchronization [req-215d1d9c-a085-401b-a4a2-ae9486c3919c req-5c56b3c2-d70e-48fb-a26b-8b8a7fcdac28 service nova] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1341.554593] env[67003]: INFO networking_nsxv3.common.synchronization [req-215d1d9c-a085-401b-a4a2-ae9486c3919c req-5c56b3c2-d70e-48fb-a26b-8b8a7fcdac28 service nova] Enqueued Resource ID: 3ed6524f-fea7-480f-80ca-599dcfccabc0 with Priority: HIGHEST for action port [ 1341.554874] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_rules [ 1341.555018] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1341.555114] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ed6524f-fea7-480f-80ca-599dcfccabc0 with Priority: HIGHEST for action port [ 1341.555407] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.555542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.555593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.555772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.555857] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.556738] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.556844] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.556908] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.557098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.557299] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.557400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.557469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.558031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.558031] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1341.558031] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1341.558964] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ed6524f-fea7-480f-80ca-599dcfccabc0 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1341.559081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1341.559218] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1341.559386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1341.559462] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ed6524f-fea7-480f-80ca-599dcfccabc0',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.061408] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.062485] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.062626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.062739] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ed6524f-fea7-480f-80ca-599dcfccabc0 with status ACTIVE [ 1342.062991] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.062991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.063160] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.064039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.064039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.064039] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.064039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.064039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.064039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.064039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.064322] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.064322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.064449] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.064518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.064592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.064701] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ed6524f-fea7-480f-80ca-599dcfccabc0 is going to be updated. [ 1342.086013] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.086179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.086244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.086453] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.086610] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.086776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ed6524f-fea7-480f-80ca-599dcfccabc0" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.566769] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.791528] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4336904f-d492-483f-88a0-a3b4b1515dfb in Status: SUCCESS [ 1342.791739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.791889] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.792141] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.792331] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.792482] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.792616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.792808] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.792892] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.792991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.793094] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4336904f-d492-483f-88a0-a3b4b1515dfb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1342.975593] env[67003]: INFO networking_nsxv3.common.synchronization [req-43c80382-96bd-4e73-ba37-949e53a5daef req-78ffea08-2255-4376-a2dd-e96153aef856 tempest-ServersNegativeTestJSON-1169075350 tempest-ServersNegativeTestJSON-1169075350-project-member] Enqueued Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1342.976292] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1342.976739] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.976869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.976918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.977206] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.977520] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1342.977670] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1342.977670] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1342.977916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1342.978039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1342.978488] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.069118] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.069515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.069515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.069890] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.070075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.070247] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be updated. [ 1343.099472] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.099734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.099734] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.099982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.100121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.112429] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 2s [ 1343.295598] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4336904f-d492-483f-88a0-a3b4b1515dfb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.480930] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.480930] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.481244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.481322] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.481369] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.481550] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.481668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.481746] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.481855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.481940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.482024] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64e2686e-5975-42cb-9a34-c279db69fed3 already deleted. [ 1343.482115] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.744029] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.744228] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-987" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.744352] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-987" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.744689] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-987" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.744958] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.745135] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.745255] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.745474] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.745619] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.745850] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1343.745969] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1343.746109] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1343.746224] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1343.746339] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1343.746481] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1343.746629] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1343.771034] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1343.771226] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1343.771349] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1343.771530] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-987" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.771986] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.772221] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.772351] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.772687] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.772826] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1343.797919] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4336904f-d492-483f-88a0-a3b4b1515dfb: rpc.has_security_group_logging(os_id): False [ 1343.815591] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.815776] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.815825] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.816016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.816112] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.816359] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.816486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.816558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.816715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.816795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.816883] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4336904f-d492-483f-88a0-a3b4b1515dfb is going to be created. [ 1343.880304] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1343.880532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1343.880532] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1343.880719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1343.880900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.892496] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4336904f-d492-483f-88a0-a3b4b1515dfb in Status: IN_PROGRESS for 2s [ 1344.276179] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.276547] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.276612] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.276924] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.277128] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.277331] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e not found, creating... [ 1344.277634] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.277833] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.277995] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.278298] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.278516] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.278878] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.279073] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.279216] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.279456] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.279615] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.279766] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e is going to be created. [ 1344.299014] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1344.299683] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1344.299683] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1344.299683] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1344.299844] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1344.300088] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.124459] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 1345.124585] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.124733] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.126512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.126512] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.126512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.126512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.126512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.126512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.126512] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.126512] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.471127] env[67003]: INFO networking_nsxv3.common.synchronization [req-43c80382-96bd-4e73-ba37-949e53a5daef req-24b30ccd-e401-4782-9a07-87d787b3c174 service nova] Enqueued Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_rules [ 1345.471462] env[67003]: INFO networking_nsxv3.common.synchronization [req-43c80382-96bd-4e73-ba37-949e53a5daef req-24b30ccd-e401-4782-9a07-87d787b3c174 service nova] Enqueued Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1345.471462] env[67003]: INFO networking_nsxv3.common.synchronization [req-43c80382-96bd-4e73-ba37-949e53a5daef req-24b30ccd-e401-4782-9a07-87d787b3c174 service nova] Enqueued Resource ID: 0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e with Priority: HIGHEST for action port [ 1345.472093] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_rules [ 1345.472256] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1345.472378] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e with Priority: HIGHEST for action port [ 1345.472739] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.472949] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.473048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.473344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.473446] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.474409] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.474550] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.474622] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.474817] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.475012] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.475156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.475258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.475430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.475538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.475623] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.476511] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.476701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.476790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.476985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.477080] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.628995] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.908071] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4336904f-d492-483f-88a0-a3b4b1515dfb in Status: SUCCESS [ 1345.908306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.979151] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.979319] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.979522] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1345.980523] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e with status ACTIVE [ 1345.980730] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.980871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.980951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.981174] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.981264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.981493] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.981592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.981659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.981832] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.981910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.982107] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1345.982242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1345.982311] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1345.982563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1345.983288] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1345.983288] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e is going to be updated. [ 1346.006773] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.006773] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.007090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.007242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.007410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.007594] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.131199] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 716cf816-3048-4122-8676-0137157fed0e: rpc.has_security_group_logging(os_id): False [ 1346.156718] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.156885] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.156960] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.157176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.181423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.182100] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.182428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.182428] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.182659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.182786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.182922] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be updated. [ 1346.275857] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.276123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.276123] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.276348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.276574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.289354] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 2s [ 1346.485675] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1346.990997] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1346.991237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1346.991237] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1346.991528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1346.991736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1346.991905] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64e2686e-5975-42cb-9a34-c279db69fed3 is going to be created. [ 1347.017179] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1347.017391] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1347.017460] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1347.017671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1347.017833] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1347.029306] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: UNINITIALIZED for 2s [ 1348.309535] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 1348.309535] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.039589] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: SUCCESS [ 1349.039818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.039983] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.040234] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.040442] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.040577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.040648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.040830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.040948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.041352] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.041352] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.543298] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.543615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.543615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.543792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.544014] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.544166] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.544238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.544426] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.544544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.544672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.544846] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.544964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.545059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.545230] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.545394] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.545495] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.545557] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.545695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.545772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.545848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.545938] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1350.048761] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64e2686e-5975-42cb-9a34-c279db69fed3: rpc.has_security_group_logging(os_id): False [ 1350.068581] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.068795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.068863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.069098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.069193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.069412] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.069514] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.069592] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.069819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.069916] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.070128] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.070229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.070292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.070439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.070541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.070717] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.070816] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.070879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.071073] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.071153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.071242] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64e2686e-5975-42cb-9a34-c279db69fed3 is going to be created. [ 1350.136055] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1350.136263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1350.136307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1350.136515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1350.136780] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1350.155519] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: IN_PROGRESS for 2s [ 1350.473804] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1350.473804] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1352.169851] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: SUCCESS [ 1352.170262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1355.474712] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1355.475033] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1359.128420] env[67003]: INFO networking_nsxv3.common.synchronization [req-9792e71f-7b68-47fb-b70b-d7fbd4f66233 req-edf9082b-4a21-4da2-a3dc-5bd62d7da478 tempest-ServerActionsTestOtherB-185944640 tempest-ServerActionsTestOtherB-185944640-project-member] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1359.128977] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGHEST for action security_group_members [ 1359.129290] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.129412] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.129483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.129681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.129859] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.129957] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.130030] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.130177] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.130898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.130898] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.632957] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.633142] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.633217] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.633432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.633528] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.633728] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.633830] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.633894] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.634058] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.634137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.634223] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be updated. [ 1359.663292] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.663447] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.663518] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.663728] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.663873] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.677711] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 2s [ 1361.542905] env[67003]: INFO networking_nsxv3.common.synchronization [req-38ccb568-869b-4f5c-9fa3-f1b02e8bca68 req-c9b7eed6-3bfc-4486-831e-3bbf77158a37 tempest-ServersNegativeTestJSON-1169075350 tempest-ServersNegativeTestJSON-1169075350-project-member] Enqueued Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1361.543464] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1361.543768] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.543892] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.543962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.544204] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.544361] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.544462] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.544523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.544674] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.544758] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.544849] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.690089] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: IN_PROGRESS for 4s [ 1361.851796] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.852086] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-987" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.852243] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-987" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.852558] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-987" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.852866] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.853065] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.853235] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.853502] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.853771] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.853926] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1361.854068] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1361.854253] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1361.854367] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1361.854531] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1361.854634] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1361.854797] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1361.875124] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1361.875400] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1361.875577] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1361.875793] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-987" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.876221] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-4a73030e-2962-4cee-9088-13104bbd7e4c taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.876448] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-4a73030e-2962-4cee-9088-13104bbd7e4c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.876585] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-4a73030e-2962-4cee-9088-13104bbd7e4c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.876963] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-4a73030e-2962-4cee-9088-13104bbd7e4c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.877137] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a73030e-2962-4cee-9088-13104bbd7e4c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.046766] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1362.379926] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.379926] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.380212] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.380324] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.380473] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.380630] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 4a73030e-2962-4cee-9088-13104bbd7e4c not found, creating... [ 1362.380940] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.381062] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.381182] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.381396] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.381531] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.381805] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.381958] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.382091] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.382313] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.382443] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.382581] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 4a73030e-2962-4cee-9088-13104bbd7e4c is going to be created. [ 1362.401419] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1362.401636] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1362.401726] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1362.401993] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1362.402232] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.402453] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-4a73030e-2962-4cee-9088-13104bbd7e4c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1362.549265] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.052333] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.052545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.052598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.052818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.052910] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.053014] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64e2686e-5975-42cb-9a34-c279db69fed3 is going to be updated. [ 1363.082478] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.082478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.082478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.082478] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.082788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.092090] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: IN_PROGRESS for 2s [ 1363.120078] env[67003]: INFO networking_nsxv3.common.synchronization [req-38ccb568-869b-4f5c-9fa3-f1b02e8bca68 req-83abea04-db1d-49c2-9fc6-b63cf68b7abd service nova] Enqueued Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_rules [ 1363.120295] env[67003]: INFO networking_nsxv3.common.synchronization [req-38ccb568-869b-4f5c-9fa3-f1b02e8bca68 req-83abea04-db1d-49c2-9fc6-b63cf68b7abd service nova] Enqueued Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1363.120478] env[67003]: INFO networking_nsxv3.common.synchronization [req-38ccb568-869b-4f5c-9fa3-f1b02e8bca68 req-83abea04-db1d-49c2-9fc6-b63cf68b7abd service nova] Enqueued Resource ID: 4a73030e-2962-4cee-9088-13104bbd7e4c with Priority: HIGHEST for action port [ 1363.120979] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_rules [ 1363.121262] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1363.121372] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a73030e-2962-4cee-9088-13104bbd7e4c with Priority: HIGHEST for action port [ 1363.121652] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.121771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.121840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.122097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.122203] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.123267] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.123329] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.123594] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a73030e-2962-4cee-9088-13104bbd7e4c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.123714] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a73030e-2962-4cee-9088-13104bbd7e4c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.123768] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a73030e-2962-4cee-9088-13104bbd7e4c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.123897] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a73030e-2962-4cee-9088-13104bbd7e4c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.123972] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a73030e-2962-4cee-9088-13104bbd7e4c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1363.626255] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.626631] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.626631] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a73030e-2962-4cee-9088-13104bbd7e4c with status ACTIVE [ 1363.626802] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.626877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.626937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.627164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.627257] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.627428] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.627544] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.627582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.628117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.628117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.628117] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.628117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.628406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.628406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.628406] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.628535] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a73030e-2962-4cee-9088-13104bbd7e4c is going to be updated. [ 1363.650589] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.650840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.650840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.651019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.651157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.651313] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a73030e-2962-4cee-9088-13104bbd7e4c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.700445] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 716cf816-3048-4122-8676-0137157fed0e in Status: SUCCESS [ 1363.700684] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 716cf816-3048-4122-8676-0137157fed0e deletion is rescheduled due to dependency. [ 1363.700813] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.102105] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: SUCCESS [ 1365.102499] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.102499] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.102663] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.102845] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1365.102962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1365.103037] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1365.103199] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1365.103276] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1365.103405] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1365.607403] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.109180] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1366.611845] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.612148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.612148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.612371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.612440] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.612532] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64e2686e-5975-42cb-9a34-c279db69fed3 is going to be updated. [ 1366.643865] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1366.644089] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1366.644140] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1366.644355] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1366.644510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1366.654630] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: IN_PROGRESS for 2s [ 1368.121971] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.122358] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1368.472238] env[67003]: INFO networking_nsxv3.common.synchronization [None req-65efda58-cf41-4776-b13f-0002d14e693d tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGHEST for action security_group_rules [ 1368.473097] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGHEST for action security_group_rules [ 1368.473097] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.473189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.473254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.473590] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.473590] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a8e48ab-ff6c-46f2-b70c-798df4637eaf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.558890] env[67003]: INFO networking_nsxv3.common.synchronization [None req-39b4f802-1c2b-4516-ab45-3f93f26341b1 tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGHEST for action security_group_rules [ 1368.559471] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGHEST for action security_group_rules [ 1368.559786] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.559882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.667815] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: SUCCESS [ 1368.668071] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.668364] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.668468] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.668663] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.668886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.668886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.669179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.669179] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.669386] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.669386] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1368.995210] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1368.995210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1368.995210] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.995821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.995821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.995821] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf already deleted. [ 1368.995821] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1368.995956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1368.996080] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1368.996207] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a8e48ab-ff6c-46f2-b70c-798df4637eaf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.171583] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.171944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.171944] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.172035] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.172248] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.173189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.173266] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.173442] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.173533] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.173627] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.173785] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.173888] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.173950] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.174121] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.174268] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.174362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.174423] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.174561] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.174639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.174717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.174807] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1369.523846] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.524122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.524122] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.524479] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.524625] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.524777] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf already deleted. [ 1369.524899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.677176] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64e2686e-5975-42cb-9a34-c279db69fed3: rpc.has_security_group_logging(os_id): False [ 1369.699300] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.699547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.699547] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.699731] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.699800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.700018] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.700117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.700181] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.700327] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.700404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.700575] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.700668] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.700730] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.700872] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.700939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.701150] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.701418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.701418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.701418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.701538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.701577] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64e2686e-5975-42cb-9a34-c279db69fed3 is going to be updated. [ 1369.764972] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1369.765211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1369.765211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1369.765397] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1369.765549] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.780093] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: IN_PROGRESS for 2s [ 1371.805207] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: SUCCESS [ 1371.805637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.645121] env[67003]: INFO networking_nsxv3.common.synchronization [req-c96b14f9-41a3-4c98-8541-fb8241a4b006 req-837755e8-5dfa-4313-911a-ebc501f937dc tempest-ServersNegativeTestJSON-1169075350 tempest-ServersNegativeTestJSON-1169075350-project-member] Enqueued Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1372.645641] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1372.645944] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.646074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.646176] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.646342] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.646522] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1372.646667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1372.646777] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1372.646951] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1372.647047] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.647173] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.150733] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.653427] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1373.959615] env[67003]: INFO networking_nsxv3.common.synchronization [req-2a8f5952-074e-4f9e-85b2-f95f3c3394b8 req-4ab12c5c-37dd-4a4b-8f24-659c0cc50343 tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGHEST for action security_group_members [ 1373.960187] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGHEST for action security_group_members [ 1373.960485] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.960604] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.960671] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.960920] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.963531] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1373.963664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1373.963759] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1373.963938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1373.964050] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1373.964150] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a8e48ab-ff6c-46f2-b70c-798df4637eaf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.155776] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.156104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.156104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.156260] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.156353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.156451] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64e2686e-5975-42cb-9a34-c279db69fed3 is going to be updated. [ 1374.184021] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.184219] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.184474] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.184560] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.184869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.194054] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: IN_PROGRESS for 2s [ 1374.217616] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.217832] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.217958] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.218238] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.218496] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.218649] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.218785] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.219008] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.219221] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.219427] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1374.219538] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1374.219643] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1374.219766] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1374.219885] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1374.219990] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1374.220139] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1374.239874] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1374.240130] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1374.240197] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1374.240371] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.240692] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-24502df4-be72-4333-9cb7-ad7ec47070ba taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.240863] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-24502df4-be72-4333-9cb7-ad7ec47070ba" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.240985] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-24502df4-be72-4333-9cb7-ad7ec47070ba" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.241330] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-24502df4-be72-4333-9cb7-ad7ec47070ba" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.241464] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24502df4-be72-4333-9cb7-ad7ec47070ba',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1374.468158] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.468158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.468158] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.468446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.468446] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.468522] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.468580] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.468649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.468837] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.468915] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.469038] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf already deleted. [ 1374.469128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.744111] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.744347] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.745025] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.745025] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.745025] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.745248] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port 24502df4-be72-4333-9cb7-ad7ec47070ba not found, creating... [ 1374.745322] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.745485] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.745603] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.745816] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.745949] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.746383] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.746383] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.746518] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.748032] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.748032] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.748032] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: 24502df4-be72-4333-9cb7-ad7ec47070ba is going to be created. [ 1374.777270] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1374.777470] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1374.777595] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1374.777865] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1374.778317] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1374.778317] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-24502df4-be72-4333-9cb7-ad7ec47070ba" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.469652] env[67003]: INFO networking_nsxv3.common.synchronization [req-2a8f5952-074e-4f9e-85b2-f95f3c3394b8 req-971af678-34fd-4fb1-9f56-157f70bea063 service nova] Enqueued Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGHEST for action security_group_rules [ 1375.469916] env[67003]: INFO networking_nsxv3.common.synchronization [req-2a8f5952-074e-4f9e-85b2-f95f3c3394b8 req-971af678-34fd-4fb1-9f56-157f70bea063 service nova] Enqueued Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGHEST for action security_group_members [ 1375.470025] env[67003]: INFO networking_nsxv3.common.synchronization [req-2a8f5952-074e-4f9e-85b2-f95f3c3394b8 req-971af678-34fd-4fb1-9f56-157f70bea063 service nova] Enqueued Resource ID: 24502df4-be72-4333-9cb7-ad7ec47070ba with Priority: HIGHEST for action port [ 1375.470533] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGHEST for action security_group_rules [ 1375.470668] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGHEST for action security_group_members [ 1375.470760] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24502df4-be72-4333-9cb7-ad7ec47070ba with Priority: HIGHEST for action port [ 1375.471078] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.471177] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.471249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.471451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.471538] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a8e48ab-ff6c-46f2-b70c-798df4637eaf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.472381] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.472471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.472542] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.472701] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.472846] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.472940] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.473011] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.473157] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.473240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.473328] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a8e48ab-ff6c-46f2-b70c-798df4637eaf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.476041] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-24502df4-be72-4333-9cb7-ad7ec47070ba taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.476041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24502df4-be72-4333-9cb7-ad7ec47070ba" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.476041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24502df4-be72-4333-9cb7-ad7ec47070ba" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.476041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24502df4-be72-4333-9cb7-ad7ec47070ba" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.476041] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24502df4-be72-4333-9cb7-ad7ec47070ba',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.977324] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1a8e48ab-ff6c-46f2-b70c-798df4637eaf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1375.978254] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.978400] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.979465] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24502df4-be72-4333-9cb7-ad7ec47070ba with status ACTIVE [ 1375.979465] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.979465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.979465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.979465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.979465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.979465] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.979465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.979465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.980040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.980040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.980040] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1375.980040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1375.980040] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1375.980368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1375.980368] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1375.980368] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24502df4-be72-4333-9cb7-ad7ec47070ba is going to be updated. [ 1376.003830] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.004115] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.004214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.004492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.004704] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.004952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24502df4-be72-4333-9cb7-ad7ec47070ba" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.204747] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: SUCCESS [ 1376.204931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.482916] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1a8e48ab-ff6c-46f2-b70c-798df4637eaf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1376.985364] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1376.985524] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1376.985598] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1376.985814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1376.985903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1376.986008] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf is going to be created. [ 1377.012093] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1377.012261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1377.012261] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1377.012467] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1377.012639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1377.022928] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf in Status: UNINITIALIZED for 2s [ 1379.034739] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf in Status: SUCCESS [ 1379.035020] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.035117] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.035348] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.035544] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1379.035659] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1379.035727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1379.035893] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1379.035984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.036083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1379.036176] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1a8e48ab-ff6c-46f2-b70c-798df4637eaf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1379.538337] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1a8e48ab-ff6c-46f2-b70c-798df4637eaf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1380.041380] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1a8e48ab-ff6c-46f2-b70c-798df4637eaf: rpc.has_security_group_logging(os_id): False [ 1380.059028] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.059167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.059250] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.059445] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.059534] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.059770] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.059904] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.059982] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.060143] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.060220] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.060350] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf is going to be created. [ 1380.118652] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1380.118740] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1380.118804] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1380.118993] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1380.119192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1380.129335] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf in Status: IN_PROGRESS for 2s [ 1380.471688] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1380.471802] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1382.142024] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf in Status: SUCCESS [ 1382.142334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1385.472788] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1385.473101] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1390.474108] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1390.474509] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1395.475235] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1395.475679] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1400.476013] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1400.476364] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1405.477496] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1405.477496] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1410.477868] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1410.478264] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1412.429079] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-987 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.429079] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-987" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.429550] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-987" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.429550] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-987" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.429736] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.429893] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.430022] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.430230] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.430375] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.430581] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1412.430695] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1412.430803] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1412.430911] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1412.431033] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1412.431144] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1412.431272] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1412.451276] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1412.451502] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1412.451660] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1412.451837] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-987" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.452163] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.452338] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.452457] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.452706] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.452851] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1412.955793] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.956031] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.956167] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.956465] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.956667] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.956967] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.957139] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.957262] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.957484] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.957622] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.957901] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.958069] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.958203] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.958413] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.958548] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.958690] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e is going to be updated. [ 1412.980476] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1412.980702] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1412.980834] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1412.981131] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1412.981336] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1412.981561] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.672286] env[67003]: INFO networking_nsxv3.common.synchronization [req-160ddf31-7757-43c2-9a79-55b36b2fcc32 req-0e719f03-a667-46b6-a97b-bce8096db7de service nova] Enqueued Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_rules [ 1413.672575] env[67003]: INFO networking_nsxv3.common.synchronization [req-160ddf31-7757-43c2-9a79-55b36b2fcc32 req-0e719f03-a667-46b6-a97b-bce8096db7de service nova] Enqueued Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1413.672816] env[67003]: INFO networking_nsxv3.common.synchronization [req-160ddf31-7757-43c2-9a79-55b36b2fcc32 req-0e719f03-a667-46b6-a97b-bce8096db7de service nova] Enqueued Resource ID: 0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e with Priority: HIGHEST for action port [ 1413.673553] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_rules [ 1413.673761] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1413.673940] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e with Priority: HIGHEST for action port [ 1413.674357] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.674543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.674703] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.674934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.675078] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.676554] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.676554] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.676554] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.676736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.676962] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.677104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.677236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.677408] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.677536] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1413.677673] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1413.679051] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1413.679051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1413.679051] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1413.679238] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1413.679288] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.181831] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.181999] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.182179] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1414.183079] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e with status ACTIVE [ 1414.183271] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.183387] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.183471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.183692] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.183782] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.183956] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.184064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.185081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.185081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.185081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.185081] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.185081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.185081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.185081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.185081] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.185081] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e is going to be updated. [ 1414.209750] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1414.209750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1414.209750] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1414.210276] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1414.210276] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.210354] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0add5df3-fb5c-4cfc-ac52-5e7ac2a2895e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1414.687429] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.189632] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.189856] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.189856] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.190132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.190232] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.190333] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64e2686e-5975-42cb-9a34-c279db69fed3 is going to be updated. [ 1415.221842] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.222107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.222107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.222296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.222440] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.233197] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: IN_PROGRESS for 2s [ 1415.366162] env[67003]: INFO networking_nsxv3.common.synchronization [req-fb058c18-8ce0-426d-94aa-593688e9c64a req-cfb363d0-c6f9-43c8-94af-53f9b83da694 tempest-AttachVolumeTestJSON-424960992 tempest-AttachVolumeTestJSON-424960992-project-member] Enqueued Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGHEST for action security_group_members [ 1415.366733] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGHEST for action security_group_members [ 1415.367076] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4336904f-d492-483f-88a0-a3b4b1515dfb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.367282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.367282] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.367427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.367574] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.367673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.367807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.367923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.367967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.368069] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4336904f-d492-483f-88a0-a3b4b1515dfb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1415.870900] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.870900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.870900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.870900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.870900] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.871488] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.871488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.871488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.871488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.871488] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.871673] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4336904f-d492-483f-88a0-a3b4b1515dfb is going to be updated. [ 1415.897385] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1415.897614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1415.897614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1415.897793] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1415.897935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1415.907879] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4336904f-d492-483f-88a0-a3b4b1515dfb in Status: IN_PROGRESS for 2s [ 1417.244187] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: SUCCESS [ 1417.244558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.244558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.244786] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.244976] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.245109] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.245180] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.245335] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.245416] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.245510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.245624] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.748579] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.748829] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.748829] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.749120] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.749406] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.749529] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.749608] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.749812] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.749921] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.750087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.750405] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.750545] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.750616] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.750784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.750947] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1417.751076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1417.751144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1417.751312] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1417.751414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.751511] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1417.751653] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1417.918747] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4336904f-d492-483f-88a0-a3b4b1515dfb in Status: SUCCESS [ 1417.918965] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4336904f-d492-483f-88a0-a3b4b1515dfb deletion is rescheduled due to dependency. [ 1417.919075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.254579] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 64e2686e-5975-42cb-9a34-c279db69fed3: rpc.has_security_group_logging(os_id): False [ 1418.273119] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.273359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.273359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.273563] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.273649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.273861] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.273957] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.274028] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.274178] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.274256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.274429] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.274519] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.274579] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.274717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.274791] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.274981] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.275087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.275132] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.275263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.275338] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.275423] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64e2686e-5975-42cb-9a34-c279db69fed3 is going to be updated. [ 1418.336061] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1418.336358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1418.336358] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1418.336582] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1418.336739] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1418.367276] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: IN_PROGRESS for 2s [ 1420.367667] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1420.368133] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1420.384742] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: SUCCESS [ 1420.385088] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.257564] env[67003]: INFO networking_nsxv3.common.synchronization [req-20fc8880-cb1f-4f09-a058-56345dcb9d9c req-5473fd83-d3b7-4000-a75e-c4ca35becfa1 tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGHEST for action security_group_members [ 1424.258178] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGHEST for action security_group_members [ 1424.258497] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.258779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.258779] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.258886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.259045] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.259171] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.259262] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.259465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.259465] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.259570] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1a8e48ab-ff6c-46f2-b70c-798df4637eaf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1424.762323] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.762577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.762577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.762748] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.762842] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.763064] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.763175] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.763240] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.763396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.763472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.763704] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf is going to be updated. [ 1424.795188] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1424.795396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1424.795396] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1424.795614] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1424.795763] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1424.805579] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf in Status: IN_PROGRESS for 2s [ 1426.817164] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf in Status: SUCCESS [ 1426.817489] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf deletion is rescheduled due to dependency. [ 1426.817489] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1429.259224] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1429.259652] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1434.260458] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1434.260458] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1436.249899] env[67003]: INFO networking_nsxv3.common.synchronization [req-96635b98-8b06-40bd-9c42-a92bd1cdc59e req-94b3ae99-1157-48c7-956b-fa42e23075b0 tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGHEST for action security_group_members [ 1436.250476] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGHEST for action security_group_members [ 1436.250784] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-9de4d310-6651-400a-a748-13441816153c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.250907] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.250971] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.251183] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.251337] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.251439] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.251494] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.251647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.251719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.251822] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9de4d310-6651-400a-a748-13441816153c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1436.754417] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.754653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.754653] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.754822] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.754914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.755120] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.755222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.755275] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.755424] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.755503] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.755589] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9de4d310-6651-400a-a748-13441816153c is going to be updated. [ 1436.782346] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1436.782538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1436.782538] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1436.782690] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1436.782831] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1436.791259] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9de4d310-6651-400a-a748-13441816153c in Status: IN_PROGRESS for 2s [ 1438.802398] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9de4d310-6651-400a-a748-13441816153c in Status: SUCCESS [ 1438.802688] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9de4d310-6651-400a-a748-13441816153c deletion is rescheduled due to dependency. [ 1438.802688] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.648742] env[67003]: INFO networking_nsxv3.common.synchronization [req-00e86600-d833-44de-9b01-ea3c8ebb1d95 req-3d66438e-4e75-415c-abcc-071be1a9e4ea tempest-ServersNegativeTestJSON-1169075350 tempest-ServersNegativeTestJSON-1169075350-project-member] Enqueued Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1440.650565] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64e2686e-5975-42cb-9a34-c279db69fed3 with Priority: HIGHEST for action security_group_members [ 1440.650565] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-64e2686e-5975-42cb-9a34-c279db69fed3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.650565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.650565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.650565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.650565] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.650565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.650565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.650565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.650565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1440.651197] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('64e2686e-5975-42cb-9a34-c279db69fed3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.884367] env[67003]: INFO networking_nsxv3.common.synchronization [None req-8cad6642-8b4c-4370-85b9-7fa8e2a13d2d tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGHEST for action security_group_rules [ 1440.884896] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGHEST for action security_group_rules [ 1440.885219] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b5148d6-c0e7-40ea-a728-1755f9047464 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.885344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1440.885410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1440.885660] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1440.885743] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b5148d6-c0e7-40ea-a728-1755f9047464',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1440.976628] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ec47d819-981e-4875-b6ef-a71e694227b1 tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGHEST for action security_group_rules [ 1440.977202] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGHEST for action security_group_rules [ 1440.977509] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b5148d6-c0e7-40ea-a728-1755f9047464 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1440.977613] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.154962] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.155153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.155225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.155451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.155543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.155740] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.155836] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.155898] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.156053] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.156130] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.156216] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64e2686e-5975-42cb-9a34-c279db69fed3 is going to be updated. [ 1441.183510] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.183665] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.183719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.183934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.184089] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.193306] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: IN_PROGRESS for 2s [ 1441.405934] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.406147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.406147] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.406362] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.406451] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.406547] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 already deleted. [ 1441.406633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.406784] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.406936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.407031] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b5148d6-c0e7-40ea-a728-1755f9047464',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1441.927811] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1441.927811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1441.927811] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1441.928314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1441.928314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1441.928314] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 already deleted. [ 1441.928314] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1443.203856] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 64e2686e-5975-42cb-9a34-c279db69fed3 in Status: SUCCESS [ 1443.204264] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 64e2686e-5975-42cb-9a34-c279db69fed3 deletion is rescheduled due to dependency. [ 1443.204264] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-64e2686e-5975-42cb-9a34-c279db69fed3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1445.978167] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1445.978426] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1446.743562] env[67003]: INFO networking_nsxv3.common.synchronization [req-242d4342-b300-4312-8cea-4aa1e8995d2c req-b7ad1645-f59e-4f24-8ecd-9b4548a3ff19 tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGHEST for action security_group_members [ 1446.744302] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGHEST for action security_group_members [ 1446.745038] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b5148d6-c0e7-40ea-a728-1755f9047464 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.745038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.745038] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.745326] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.745399] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1446.745556] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1446.745673] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1446.745881] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1446.746008] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1446.746146] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b5148d6-c0e7-40ea-a728-1755f9047464',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.063835] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.064208] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.064208] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.064465] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.064722] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.064851] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.064946] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.065180] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.065337] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.065529] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1447.065644] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1447.065792] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1447.065884] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1447.065972] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1447.066099] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1447.066239] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1447.086845] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1447.087061] env[67003]: DEBUG dogpile.cache.region [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1447.087187] env[67003]: DEBUG dogpile.lock [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1447.087408] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.087745] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock port-b3944e0f-3cda-4459-a008-76e3344cd1a1 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.087914] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "port-b3944e0f-3cda-4459-a008-76e3344cd1a1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.088046] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "port-b3944e0f-3cda-4459-a008-76e3344cd1a1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.088374] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "port-b3944e0f-3cda-4459-a008-76e3344cd1a1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.088625] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3944e0f-3cda-4459-a008-76e3344cd1a1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1447.248856] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.249097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.249097] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.249303] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.249367] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.249616] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.249723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.249788] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.249948] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.250054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.250142] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 already deleted. [ 1447.250225] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.591060] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.591309] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.591438] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.591757] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.591905] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.592066] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Segment Port b3944e0f-3cda-4459-a008-76e3344cd1a1 not found, creating... [ 1447.592324] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.592480] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.592594] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.592808] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.592939] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.593294] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.593452] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.593566] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.593769] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.593988] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.594142] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Resource: SegmentPort with ID: b3944e0f-3cda-4459-a008-76e3344cd1a1 is going to be created. [ 1447.615225] env[67003]: DEBUG networking_nsxv3.common.locking [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1447.615452] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1447.615570] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1447.615838] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1447.616084] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1447.616312] env[67003]: DEBUG oslo_concurrency.lockutils [None req-1825c429-b18d-4014-9101-c6acd331f59b None None] Releasing lock "port-b3944e0f-3cda-4459-a008-76e3344cd1a1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.296109] env[67003]: INFO networking_nsxv3.common.synchronization [req-242d4342-b300-4312-8cea-4aa1e8995d2c req-ba3fa262-a418-4c92-83af-e5771b417b72 service nova] Enqueued Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGHEST for action security_group_rules [ 1448.296502] env[67003]: INFO networking_nsxv3.common.synchronization [req-242d4342-b300-4312-8cea-4aa1e8995d2c req-ba3fa262-a418-4c92-83af-e5771b417b72 service nova] Enqueued Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGHEST for action security_group_members [ 1448.296502] env[67003]: INFO networking_nsxv3.common.synchronization [req-242d4342-b300-4312-8cea-4aa1e8995d2c req-ba3fa262-a418-4c92-83af-e5771b417b72 service nova] Enqueued Resource ID: b3944e0f-3cda-4459-a008-76e3344cd1a1 with Priority: HIGHEST for action port [ 1448.296999] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGHEST for action security_group_rules [ 1448.296999] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGHEST for action security_group_members [ 1448.297220] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3944e0f-3cda-4459-a008-76e3344cd1a1 with Priority: HIGHEST for action port [ 1448.297664] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b5148d6-c0e7-40ea-a728-1755f9047464 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.297846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.297882] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.298070] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.298156] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b5148d6-c0e7-40ea-a728-1755f9047464',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.299188] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b5148d6-c0e7-40ea-a728-1755f9047464 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.299236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.299438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.299648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.299815] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.299924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.299990] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.300156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.300244] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.300363] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b5148d6-c0e7-40ea-a728-1755f9047464',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.301452] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3944e0f-3cda-4459-a008-76e3344cd1a1 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.301566] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3944e0f-3cda-4459-a008-76e3344cd1a1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.301635] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3944e0f-3cda-4459-a008-76e3344cd1a1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.301787] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3944e0f-3cda-4459-a008-76e3344cd1a1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.301861] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3944e0f-3cda-4459-a008-76e3344cd1a1',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.803454] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b5148d6-c0e7-40ea-a728-1755f9047464 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.803584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.803764] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b5148d6-c0e7-40ea-a728-1755f9047464',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1448.804685] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3944e0f-3cda-4459-a008-76e3344cd1a1 with status ACTIVE [ 1448.804871] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.804984] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.805064] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.805270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.805359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.805526] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.805621] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.805682] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.805828] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.805927] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.806120] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.806213] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.806293] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.806531] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.806624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.806661] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3944e0f-3cda-4459-a008-76e3344cd1a1 is going to be updated. [ 1448.830419] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1448.830646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1448.830646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1448.830827] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1448.830964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1448.831137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3944e0f-3cda-4459-a008-76e3344cd1a1" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.308644] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b5148d6-c0e7-40ea-a728-1755f9047464',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1449.811224] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.811476] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.811476] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.811687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.811783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.811889] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 is going to be created. [ 1449.835355] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1449.835584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1449.835584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1449.835743] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1449.835906] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1449.846069] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 in Status: UNINITIALIZED for 2s [ 1451.856959] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 in Status: SUCCESS [ 1451.857378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.857378] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.857583] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.857810] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1451.857963] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1451.858059] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1451.858302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1451.858437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.858574] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1451.858678] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b5148d6-c0e7-40ea-a728-1755f9047464',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1452.361226] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b5148d6-c0e7-40ea-a728-1755f9047464',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1452.863729] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b5148d6-c0e7-40ea-a728-1755f9047464: rpc.has_security_group_logging(os_id): False [ 1452.882220] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.882432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.882432] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.882640] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.882751] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.883015] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.883128] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.883194] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.883360] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.883435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.883523] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 is going to be created. [ 1452.943067] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1452.943287] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1452.943287] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1452.943492] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1452.943677] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1452.956439] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 in Status: IN_PROGRESS for 2s [ 1453.297942] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.298145] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1454.969977] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 in Status: SUCCESS [ 1454.970435] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.298747] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.298747] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1463.299434] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.299882] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1468.300169] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1468.300548] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1473.301701] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1473.302101] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1478.302789] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1478.303166] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1483.303730] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1483.304174] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1488.305092] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1488.305485] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1493.305919] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1493.306393] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1498.306854] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1498.307365] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1500.703022] env[67003]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1500.703452] env[67003]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-7375be5a-ce5c-41b1-9f33-94e2979370bd None None] NSXv3 Agent Agent loop - iteration:4 started [ 1503.307754] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1503.308178] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1508.309281] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1508.309591] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1511.932196] env[67003]: INFO networking_nsxv3.common.synchronization [req-81b8f4ba-2165-4eed-8444-27dc6f9766ce req-b7c137b6-8863-4538-ae50-14a313afb9b9 tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGHEST for action security_group_members [ 1511.932989] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGHEST for action security_group_members [ 1511.933361] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b5148d6-c0e7-40ea-a728-1755f9047464 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.933526] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.933597] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.933820] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.933974] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1511.934091] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1511.934153] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1511.934330] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1511.934418] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1511.934513] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b5148d6-c0e7-40ea-a728-1755f9047464',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1512.436424] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.436647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.436647] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.436862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.437015] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.437247] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.437359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.437421] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.437575] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.437652] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.437738] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 is going to be updated. [ 1512.474688] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.474914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.474914] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.475113] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.475256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1512.485149] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 in Status: IN_PROGRESS for 2s [ 1512.651218] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1512.651414] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1512.651456] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1512.651672] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1512.651783] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.153971] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1513.656261] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1514.158847] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1514.159223] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1514.501568] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 in Status: SUCCESS [ 1514.501746] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 deletion is rescheduled due to dependency. [ 1514.501795] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1514.897682] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1514.897934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1514.897934] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1514.898151] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.049862] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1515.050802] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.051927] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1515.087621] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.087862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.087862] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.088074] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.103156] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.103945] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1515.104038] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1515.104127] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1515.143530] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.143752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.143752] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.143939] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.144771] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.144941] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1515.226905] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.227332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.227332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.227332] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.227661] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.227952] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1515.299132] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.299415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.299415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.299554] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.299840] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.300137] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:28. [ 1515.300235] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a73c2b37-9987-4ee9-8def-05a85741b451', '1b5148d6-c0e7-40ea-a728-1755f9047464', 'ea11303f-c0fb-4922-8c26-9eb29fdbf672', '64b82baf-96b3-4d2a-a0f3-634fd5e24137', '00a6980b-e22e-4c0a-a83a-f2c84907f57a', 'aa8a0a38-37aa-4674-acd4-bfc56f11a31e', '1a8e48ab-ff6c-46f2-b70c-798df4637eaf', '4ec9467a-c24b-4be1-ba5a-173726e27cfc', '4ca7593b-6cf9-418e-9d37-bb09b986e001', '9f930f78-bc74-4f34-9558-0ffb6faee5ec', '9de4d310-6651-400a-a748-13441816153c', 'a279ae9a-5f5b-4b3f-a403-fcef8683474d', '25f0058d-8729-4623-a291-7d3376597063', '09ad0af4-47bb-47f8-a343-07c0b9be11a8', '879b3713-7487-492d-b6e1-77747451fce3', 'f2e25f5a-d04c-463f-a7f6-17866b02d583', '032f92e2-50d8-4e5f-901e-8c80dbcfbdf5', '716cf816-3048-4122-8676-0137157fed0e', '4336904f-d492-483f-88a0-a3b4b1515dfb', 'b1fb9da3-caa0-493e-935e-25393509c210', 'b0a0dd07-31c8-4f23-b815-1cf422605b14', 'd9485466-865a-4183-ac2a-0720f6740f8a', '7a631474-f774-4747-8676-6477b61cae29', 'ea05aafd-d89a-4a4a-8f6a-25194a42d3e1', 'eda6bee5-9b5c-4b6f-888f-231f9c7282b1', '02817089-de2d-4fa5-aa82-3c16b3cb154a', 'c7f76d7e-ac8b-403e-8138-5cfc21622e31', '64e2686e-5975-42cb-9a34-c279db69fed3'} {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1515.300332] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1515.320162] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.320339] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.320381] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.320558] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.320641] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.320753] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1515.320830] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1515.320899] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1515.406714] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1515.406943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1515.406943] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1515.407134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1515.408340] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1515.408586] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1515.408664] env[67003]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=67003) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1515.408736] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1515.408803] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1515.408894] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/28 resources of Type:Security Group Rules [ 1515.408959] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGH for action security_group_rules [ 1515.409055] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGH for action security_group_rules [ 1515.409125] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGH for action security_group_rules [ 1515.409177] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGH for action security_group_rules [ 1515.409238] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGH for action security_group_rules [ 1515.409298] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e with Priority: HIGH for action security_group_rules [ 1515.409354] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGH for action security_group_rules [ 1515.409413] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGH for action security_group_rules [ 1515.409472] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGH for action security_group_rules [ 1515.409531] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec with Priority: HIGH for action security_group_rules [ 1515.409591] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGH for action security_group_rules [ 1515.409651] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGH for action security_group_rules [ 1515.409712] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGH for action security_group_rules [ 1515.409805] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGH for action security_group_rules [ 1515.409874] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 879b3713-7487-492d-b6e1-77747451fce3 with Priority: HIGH for action security_group_rules [ 1515.409935] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGH for action security_group_rules [ 1515.409995] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 with Priority: HIGH for action security_group_rules [ 1515.410068] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGH for action security_group_rules [ 1515.410130] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGH for action security_group_rules [ 1515.410191] env[67003]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGH for action security_group_rules [ 1515.410284] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.850767] env[67003]: INFO networking_nsxv3.common.synchronization [None req-ffadd391-9b23-493d-9930-1225459e0d26 tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 with Priority: HIGHEST for action security_group_rules [ 1516.851463] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 with Priority: HIGHEST for action security_group_rules [ 1516.851644] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a73c2b37-9987-4ee9-8def-05a85741b451 with Priority: HIGH for action security_group_rules [ 1516.851789] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 with Priority: HIGH for action security_group_rules [ 1516.851948] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf with Priority: HIGH for action security_group_rules [ 1516.852073] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 879b3713-7487-492d-b6e1-77747451fce3 with Priority: HIGH for action security_group_rules [ 1516.852227] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1fb9da3-caa0-493e-935e-25393509c210 with Priority: HIGH for action security_group_rules [ 1516.852372] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4336904f-d492-483f-88a0-a3b4b1515dfb with Priority: HIGH for action security_group_rules [ 1516.852506] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716cf816-3048-4122-8676-0137157fed0e with Priority: HIGH for action security_group_rules [ 1516.852659] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 with Priority: HIGH for action security_group_rules [ 1516.852798] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 with Priority: HIGH for action security_group_rules [ 1516.852948] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 with Priority: HIGH for action security_group_rules [ 1516.853135] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25f0058d-8729-4623-a291-7d3376597063 with Priority: HIGH for action security_group_rules [ 1516.853258] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d with Priority: HIGH for action security_group_rules [ 1516.853366] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9de4d310-6651-400a-a748-13441816153c with Priority: HIGH for action security_group_rules [ 1516.853503] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec with Priority: HIGH for action security_group_rules [ 1516.853649] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 with Priority: HIGH for action security_group_rules [ 1516.853756] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e with Priority: HIGH for action security_group_rules [ 1516.853849] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc with Priority: HIGH for action security_group_rules [ 1516.853937] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a with Priority: HIGH for action security_group_rules [ 1516.854035] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 with Priority: HIGH for action security_group_rules [ 1516.854187] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 with Priority: HIGH for action security_group_rules [ 1516.854832] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.854988] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.855112] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.855410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.855515] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f44fcb4-dc9f-4c77-a909-5d2490760dd2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.856725] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a73c2b37-9987-4ee9-8def-05a85741b451 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.856860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.856931] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.857192] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.857324] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a73c2b37-9987-4ee9-8def-05a85741b451',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.858523] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.858523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.858523] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.858967] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.858967] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ea11303f-c0fb-4922-8c26-9eb29fdbf672',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.859792] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.859792] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.859989] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.860065] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.860118] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1a8e48ab-ff6c-46f2-b70c-798df4637eaf',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.860966] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-879b3713-7487-492d-b6e1-77747451fce3 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.860966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.860966] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.861450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.861450] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('879b3713-7487-492d-b6e1-77747451fce3',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.861933] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1fb9da3-caa0-493e-935e-25393509c210 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.862041] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.862108] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.862258] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.862340] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1fb9da3-caa0-493e-935e-25393509c210',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.863057] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4336904f-d492-483f-88a0-a3b4b1515dfb taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.863214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.863214] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.863477] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.863477] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4336904f-d492-483f-88a0-a3b4b1515dfb',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.864633] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-716cf816-3048-4122-8676-0137157fed0e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.864633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.864633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.864633] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.864633] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('716cf816-3048-4122-8676-0137157fed0e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.865282] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.865404] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.865463] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.865686] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.865686] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('032f92e2-50d8-4e5f-901e-8c80dbcfbdf5',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.866382] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.866496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.866496] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.866620] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.866699] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('09ad0af4-47bb-47f8-a343-07c0b9be11a8',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.867380] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2e25f5a-d04c-463f-a7f6-17866b02d583 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.868017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.868017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.868017] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.868017] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2e25f5a-d04c-463f-a7f6-17866b02d583',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.868544] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25f0058d-8729-4623-a291-7d3376597063 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.868667] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.868736] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.868903] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.868951] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25f0058d-8729-4623-a291-7d3376597063',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.869900] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.870019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.870063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.870195] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.870268] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a279ae9a-5f5b-4b3f-a403-fcef8683474d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.871515] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9de4d310-6651-400a-a748-13441816153c taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.871515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.871515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.871515] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.871515] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9de4d310-6651-400a-a748-13441816153c',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.873368] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f930f78-bc74-4f34-9558-0ffb6faee5ec taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.873472] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.873543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.873687] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.873758] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f930f78-bc74-4f34-9558-0ffb6faee5ec',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.874445] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ca7593b-6cf9-418e-9d37-bb09b986e001 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.874555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.874618] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.874798] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.874873] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ca7593b-6cf9-418e-9d37-bb09b986e001',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.875553] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aa8a0a38-37aa-4674-acd4-bfc56f11a31e taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.875664] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.876139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.876139] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.876139] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aa8a0a38-37aa-4674-acd4-bfc56f11a31e',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.876745] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.876857] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.876925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.877082] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.877154] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ec9467a-c24b-4be1-ba5a-173726e27cfc',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.878097] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.878292] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.878427] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.878657] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.878797] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00a6980b-e22e-4c0a-a83a-f2c84907f57a',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.879643] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b5148d6-c0e7-40ea-a728-1755f9047464 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.879834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.879918] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.880215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.880333] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b5148d6-c0e7-40ea-a728-1755f9047464',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.881550] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.881707] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.881834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.882306] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.882306] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('64b82baf-96b3-4d2a-a0f3-634fd5e24137',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1516.915908] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.916118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.916193] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.916402] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.918747] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.918878] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.921212] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.921338] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.922867] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.922978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.925928] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.926039] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.938380] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.938516] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a73c2b37-9987-4ee9-8def-05a85741b451 is going to be deleted. [ 1516.939422] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.939628] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.942736] env[67003]: INFO networking_nsxv3.common.synchronization [None req-2cb32f71-b222-41f8-ba03-fea449da8a97 tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 with Priority: HIGHEST for action security_group_rules [ 1516.943525] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 with Priority: HIGHEST for action security_group_rules [ 1516.943824] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.943924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1516.965644] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.965796] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1a8e48ab-ff6c-46f2-b70c-798df4637eaf is going to be deleted. [ 1516.966681] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.966871] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.983345] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1516.983499] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 879b3713-7487-492d-b6e1-77747451fce3 is going to be deleted. [ 1516.984331] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1516.984543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1516.996728] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1516.996938] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.006438] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.006673] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1fb9da3-caa0-493e-935e-25393509c210 is going to be deleted. [ 1517.007684] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.007925] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.028848] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.029098] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ea11303f-c0fb-4922-8c26-9eb29fdbf672 is going to be deleted. [ 1517.029954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.030270] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.030403] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.030541] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a73c2b37-9987-4ee9-8def-05a85741b451" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.052738] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.053016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.053144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.053475] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.053636] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.053818] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-879b3713-7487-492d-b6e1-77747451fce3" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.055397] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.055584] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.055735] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.055991] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.056222] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.056316] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1a8e48ab-ff6c-46f2-b70c-798df4637eaf" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.119382] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.119593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.119593] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.119809] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.119877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.120011] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1fb9da3-caa0-493e-935e-25393509c210" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.124631] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.124819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.124819] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.125044] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.125137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.125242] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ea11303f-c0fb-4922-8c26-9eb29fdbf672" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.410701] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.410956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.410956] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.411191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.413566] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.413669] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.420529] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.420648] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.421401] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.421499] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.429561] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.429772] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.438794] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.438962] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.439765] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.439899] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.443732] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.443854] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.447870] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.447870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.449371] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.449371] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.450044] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.450164] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.451072] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1517.451700] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.451834] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.452789] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1517.453391] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.453483] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.454447] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1517.455022] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.455144] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.456200] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1517.456297] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.456373] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.457082] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1517.457518] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.457649] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.458227] env[67003]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1517.458807] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.458807] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 032f92e2-50d8-4e5f-901e-8c80dbcfbdf5 is going to be deleted. [ 1517.459879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.460134] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.479838] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.480055] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ca7593b-6cf9-418e-9d37-bb09b986e001 is going to be deleted. [ 1517.481075] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.481305] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.500302] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.500459] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a279ae9a-5f5b-4b3f-a403-fcef8683474d is going to be deleted. [ 1517.501359] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.501570] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.516442] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.516678] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.523196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.523360] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00a6980b-e22e-4c0a-a83a-f2c84907f57a is going to be deleted. [ 1517.524229] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.524450] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.535852] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.536063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.553149] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.553372] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aa8a0a38-37aa-4674-acd4-bfc56f11a31e is going to be deleted. [ 1517.554719] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.555045] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.556804] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.556913] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.583624] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.583855] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.584869] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.584992] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9de4d310-6651-400a-a748-13441816153c is going to be deleted. [ 1517.585886] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.586118] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.621755] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.621966] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 09ad0af4-47bb-47f8-a343-07c0b9be11a8 is going to be deleted. [ 1517.622854] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.623090] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.647923] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.648104] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b5148d6-c0e7-40ea-a728-1755f9047464 is going to be deleted. [ 1517.649167] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.649394] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.666380] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.666637] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.700543] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.700704] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4336904f-d492-483f-88a0-a3b4b1515dfb is going to be deleted. [ 1517.701715] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.701936] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.709903] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.710104] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.736521] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.736721] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.764766] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.764940] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2e25f5a-d04c-463f-a7f6-17866b02d583 is going to be deleted. [ 1517.765877] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.766346] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.766507] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.766625] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 already deleted. [ 1517.766722] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.766941] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.767148] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.768185] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.768372] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.768465] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f44fcb4-dc9f-4c77-a909-5d2490760dd2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1517.802324] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.802497] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.805297] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.805443] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ec9467a-c24b-4be1-ba5a-173726e27cfc is going to be deleted. [ 1517.806567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.806800] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.889203] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.889476] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 716cf816-3048-4122-8676-0137157fed0e is going to be deleted. [ 1517.890883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.891226] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.895536] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.895693] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.943851] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.944136] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25f0058d-8729-4623-a291-7d3376597063 is going to be deleted. [ 1517.945011] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.945249] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1517.947186] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.947296] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.956272] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1517.956471] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1517.976425] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1517.976570] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f930f78-bc74-4f34-9558-0ffb6faee5ec is going to be deleted. [ 1517.977467] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1517.977698] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.028034] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.028262] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 64b82baf-96b3-4d2a-a0f3-634fd5e24137 is going to be deleted. [ 1518.029125] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.029344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.029437] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.029554] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-032f92e2-50d8-4e5f-901e-8c80dbcfbdf5" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.030416] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.030555] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.030607] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.030790] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.030889] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.030985] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-716cf816-3048-4122-8676-0137157fed0e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.031129] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.031277] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.031356] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.031469] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ca7593b-6cf9-418e-9d37-bb09b986e001" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.031987] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.032168] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.032247] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.032361] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a279ae9a-5f5b-4b3f-a403-fcef8683474d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.032499] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.032639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.032717] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.032846] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00a6980b-e22e-4c0a-a83a-f2c84907f57a" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.032958] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.033115] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.033189] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.033337] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aa8a0a38-37aa-4674-acd4-bfc56f11a31e" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.033430] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.033567] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.033650] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.033814] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9de4d310-6651-400a-a748-13441816153c" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.033937] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.034098] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.034174] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.034285] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-09ad0af4-47bb-47f8-a343-07c0b9be11a8" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.034413] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.034551] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.034624] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.034732] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b5148d6-c0e7-40ea-a728-1755f9047464" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.034843] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.034978] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.035063] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.035177] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4336904f-d492-483f-88a0-a3b4b1515dfb" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.035307] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.035443] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.035516] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.035613] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2e25f5a-d04c-463f-a7f6-17866b02d583" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.035723] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.035860] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.035935] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.036048] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ec9467a-c24b-4be1-ba5a-173726e27cfc" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.080113] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.080333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.080333] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.080578] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.080727] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.080995] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25f0058d-8729-4623-a291-7d3376597063" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.133755] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.133964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.133964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.134196] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.134294] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.134415] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f930f78-bc74-4f34-9558-0ffb6faee5ec" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.174038] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.174263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.174263] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.174410] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.174498] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.174615] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-64b82baf-96b3-4d2a-a0f3-634fd5e24137" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.310396] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1518.310646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1518.310646] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1518.310861] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1518.310924] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1518.310999] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 already deleted. [ 1518.311087] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1521.944662] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1521.945084] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1522.405986] env[67003]: INFO networking_nsxv3.common.synchronization [req-0bd38be3-cf7a-4399-ad2d-de215c5a602a req-f396e6b4-a5d9-4b0b-a9d1-680dd2703e0d tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 with Priority: HIGHEST for action security_group_members [ 1522.406522] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 with Priority: HIGHEST for action security_group_members [ 1522.406823] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.406969] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.407076] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.407295] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.407453] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.407553] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.407626] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.407760] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.407868] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.407965] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f44fcb4-dc9f-4c77-a909-5d2490760dd2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.740444] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock network-2 taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.740649] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.740900] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.741062] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.741307] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.741465] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.741579] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.741796] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.741938] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.742223] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1522.742343] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] NeedRegenerationException {{(pid=67003) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1522.742452] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] no value, waiting for create lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1522.742559] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] value creation lock acquired {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1522.742669] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] No value present for key: 'zone-id' {{(pid=67003) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1522.742773] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Calling creation function for not-yet-present value {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1522.742910] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1522.762723] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1522.762878] env[67003]: DEBUG dogpile.cache.region [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67003) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1522.762985] env[67003]: DEBUG dogpile.lock [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Released creation lock {{(pid=67003) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1522.763171] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "network-2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.763467] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock port-94877565-5080-47e3-8b50-24975a90209d taken with stack trace [, , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.763636] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "port-94877565-5080-47e3-8b50-24975a90209d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.763754] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "port-94877565-5080-47e3-8b50-24975a90209d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.764099] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "port-94877565-5080-47e3-8b50-24975a90209d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.764239] env[67003]: DEBUG networking_nsxv3.api.rpc [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94877565-5080-47e3-8b50-24975a90209d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1522.909740] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.910016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.910016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.910236] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.910344] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.910545] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1522.910639] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1522.910695] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1522.910874] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1522.910954] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1522.911053] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 already deleted. [ 1522.911137] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.266186] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.266593] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.266593] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.266852] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.267023] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.267219] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Segment Port 94877565-5080-47e3-8b50-24975a90209d not found, creating... [ 1523.267511] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.267678] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.267796] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.268032] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.268174] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.268451] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.268605] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.268723] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.268939] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.269085] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.269222] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Resource: SegmentPort with ID: 94877565-5080-47e3-8b50-24975a90209d is going to be created. [ 1523.287617] env[67003]: DEBUG networking_nsxv3.common.locking [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.287796] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.287908] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.288174] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.288393] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.288609] env[67003]: DEBUG oslo_concurrency.lockutils [None req-0263c2bb-beeb-4f7a-9a11-39947d804778 None None] Releasing lock "port-94877565-5080-47e3-8b50-24975a90209d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.990575] env[67003]: INFO networking_nsxv3.common.synchronization [req-0bd38be3-cf7a-4399-ad2d-de215c5a602a req-e6a5c785-3831-4435-98a8-825c2ff382a7 service nova] Enqueued Resource ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 with Priority: HIGHEST for action security_group_rules [ 1523.990757] env[67003]: INFO networking_nsxv3.common.synchronization [req-0bd38be3-cf7a-4399-ad2d-de215c5a602a req-e6a5c785-3831-4435-98a8-825c2ff382a7 service nova] Enqueued Resource ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 with Priority: HIGHEST for action security_group_members [ 1523.990907] env[67003]: INFO networking_nsxv3.common.synchronization [req-0bd38be3-cf7a-4399-ad2d-de215c5a602a req-e6a5c785-3831-4435-98a8-825c2ff382a7 service nova] Enqueued Resource ID: 94877565-5080-47e3-8b50-24975a90209d with Priority: HIGHEST for action port [ 1523.991452] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 with Priority: HIGHEST for action security_group_rules [ 1523.991589] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 with Priority: HIGHEST for action security_group_members [ 1523.991686] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 94877565-5080-47e3-8b50-24975a90209d with Priority: HIGHEST for action port [ 1523.991956] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.992094] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.992184] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.992353] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.992433] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4f44fcb4-dc9f-4c77-a909-5d2490760dd2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1523.993248] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.993365] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.993433] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.993588] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.993733] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.993845] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.993891] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.994016] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.994107] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1523.994197] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f44fcb4-dc9f-4c77-a909-5d2490760dd2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1523.994929] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock port-94877565-5080-47e3-8b50-24975a90209d taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1523.995111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-94877565-5080-47e3-8b50-24975a90209d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1523.995111] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-94877565-5080-47e3-8b50-24975a90209d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1523.995254] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-94877565-5080-47e3-8b50-24975a90209d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1523.995328] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('94877565-5080-47e3-8b50-24975a90209d',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.500510] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4f44fcb4-dc9f-4c77-a909-5d2490760dd2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1524.500510] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2 taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.500510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.500510] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 94877565-5080-47e3-8b50-24975a90209d with status ACTIVE [ 1524.500510] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.500510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.500510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.500510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.500510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.500510] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.500510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.500510] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.501577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.501577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.501577] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.501577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.501577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.501577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.501577] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.501577] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 94877565-5080-47e3-8b50-24975a90209d is going to be updated. [ 1524.522941] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1524.523215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1524.523215] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1524.523879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1524.523879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1524.523879] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-94877565-5080-47e3-8b50-24975a90209d" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.003663] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4f44fcb4-dc9f-4c77-a909-5d2490760dd2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1525.506463] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.506870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.506870] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.506964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.506964] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.507083] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 is going to be created. [ 1525.531814] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1525.532054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1525.532054] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1525.532223] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1525.532384] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1525.542285] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 in Status: UNINITIALIZED for 2s [ 1527.555066] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 in Status: SUCCESS [ 1527.555066] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.555066] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.555612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.555612] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1527.555612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1527.555612] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1527.555783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1527.555783] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.555867] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1527.555956] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4f44fcb4-dc9f-4c77-a909-5d2490760dd2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1528.061451] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4f44fcb4-dc9f-4c77-a909-5d2490760dd2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1528.563913] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4f44fcb4-dc9f-4c77-a909-5d2490760dd2: rpc.has_security_group_logging(os_id): False [ 1528.580690] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.580889] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.580889] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.581099] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.581191] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.581430] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.581537] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.581601] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.581748] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.581824] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.581911] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 is going to be created. [ 1528.644060] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1528.644060] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1528.644060] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1528.644334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1528.644334] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1528.658230] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 in Status: IN_PROGRESS for 2s [ 1528.993260] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1528.993466] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1530.670743] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 in Status: SUCCESS [ 1530.671211] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1533.994486] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1533.994945] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1538.995590] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1538.995590] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1543.996903] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1543.997365] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1548.998360] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1548.998780] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1553.999386] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1553.999739] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1559.000557] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1559.000557] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1564.001885] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1564.001885] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1569.002802] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1569.003247] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1574.004142] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1574.004553] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1579.005600] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1579.005600] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1584.006788] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1584.007241] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1586.172590] env[67003]: INFO networking_nsxv3.common.synchronization [req-8c4e7597-f9c4-4bdd-9d69-599639052e5d req-30d32f12-9f97-466c-80a0-a1844949ce26 tempest-AttachVolumeNegativeTest-620291002 tempest-AttachVolumeNegativeTest-620291002-project-member] Enqueued Resource ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 with Priority: HIGHEST for action security_group_members [ 1586.172590] env[67003]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 with Priority: HIGHEST for action security_group_members [ 1586.172590] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2 taken with stack trace [, , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.172883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.172883] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.172946] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.173654] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.173654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.173654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.173654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.173654] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.173654] env[67003]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4f44fcb4-dc9f-4c77-a909-5d2490760dd2',) {} {{(pid=67003) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1586.676418] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.676642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.676642] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.676863] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.676952] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.677159] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.677256] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.677318] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.677486] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.677565] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.677651] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 is going to be updated. [ 1586.713782] env[67003]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67003) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1586.714019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1586.714019] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1586.714200] env[67003]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1586.714343] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1586.723287] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 in Status: IN_PROGRESS for 2s [ 1588.733695] env[67003]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 in Status: SUCCESS [ 1588.734083] env[67003]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4f44fcb4-dc9f-4c77-a909-5d2490760dd2 deletion is rescheduled due to dependency. [ 1588.734083] env[67003]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4f44fcb4-dc9f-4c77-a909-5d2490760dd2" {{(pid=67003) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1591.173699] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1591.174134] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1596.175091] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1596.175447] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1601.176422] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1601.176820] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1606.178320] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1606.178693] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1611.179544] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1611.179899] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1616.180781] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1616.181331] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1621.181537] env[67003]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1621.182120] env[67003]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0